feat(GFX1100-TG200): prefill M-tiled K-quant GEMM (VT_PREFILL_TILE) - #2891

Closed

ghazni101 wants to merge 10 commits into

mudler:mainfrom

ghazni101:row/GFX1100-TG200-T36

Commits on Sep 4, 2026

feat(KERNEL-QUANT-CIQ-GEMM-ROCM): land the W1 keep-quant providers on kROCM
ghazni101
committed
73478f6
perf(GFX1100-TG200): T4a MMVQ K-quant decode GEMV arm
ghazni101
committed
51f5222
feat(GFX1100-TG200): lever-C fuses Q8_K activation quant into the RmsNorm epilogue
ghazni101
committed
1c913d2
T27: warp-cooperative QuantizeQ8KK for decode (+2.06%, byte-identical)
ghazni101
committed
0b88e0c
feat(GFX1100-TG200): T24 LDS-buffered quant epilogue in RmsNormRowCoopKernel
ghazni101
committed
6a21478
feat(GFX1100-TG200): T21 keep-quant for V-head row-permuted GDN projections
ghazni101
committed
242da3d
T25: keep ssm_out as Q5_K with runtime input permutation
ghazni101
committed
fdfb339
T36: prefill M-tiled K-quant GEMM streams weight rows once (VT_PREFILL_TILE)
ghazni101
committed
c1033d3

Commits on Sep 5, 2026