Skip to content

[5/5][WIP] feat: request-aligned DBO ubatch splitting (flag off by default) - #336

Open
specture724 wants to merge 1 commit into
afd/async-gpu-cudagraphfrom
afd/async-gpu-dbo
Open

specture724 wants to merge 1 commit into
afd/async-gpu-cudagraphfrom
afd/async-gpu-dbo

feat: overlap whole requests across DBO ubatches

c9d922c
Select commit
Loading
Failed to load commit list.