perf(laguna): CUDA-graph replay decode — 113→143 tok/s all-GPU, 101→129 at 60% residency#358

Merged

davide221 merged 6 commits into

mainfrom

feat/laguna-cudagraph-replay

Jun 10, 2026

Commits on Jun 9, 2026

perf(laguna): CUDA-graph replay decode — 113→143 tok/s all-GPU, 101→129 at 60% residency

davide221
and
wozcode
committed
fix(laguna): address cubic P1s — thread_local decode arenas, clamp bench args

davide221
and
wozcode
committed