perf(sparse_moe): keep two Q4 group quads in flight in the routed gate/up dot product - #199

Open

MichaelDementii wants to merge 2 commits into

Neroued:masterfrom

MichaelDementii:perf/moe-decode-d3-feed-depth

Commits on Sep 7, 2026

perf(sparse-moe): keep two Q4 group quads in flight in the routed gate/up dot product
ARVLab
committed
e52e1be

Commits on Sep 9, 2026

perf(sparse_moe): keep one quad in flight on the T = 1 decode path

MichaelDementii
and
claude
committed
a04b5fe