perf(GFX1100-TG200): T6b cooperative attn preamble arm - #2868

Open

ghazni101 wants to merge 15 commits into

mudler:mainfrom

ghazni101:row/GFX1100-TG200-T6b

Commits on Sep 6, 2026

feat(KERNEL-QUANT-CIQ-GEMM-ROCM): land the W1 keep-quant providers on kROCM
ghazni101
committed
bf751f2
fix(KERNEL-QUANT-CIQ-GEMM-ROCM): keep grouped Q8_0 on the kROCM provider

mudler
authored and
ghazni101
committed
e8f52bc
Revert "fix(KERNEL-QUANT-CIQ-GEMM-ROCM): keep grouped Q8_0 on the kROCM provider"

mudler
authored and
ghazni101
committed
87d9d9d
fix(KERNEL-QUANT-CIQ-GEMM-ROCM): keep grouped Q8_0 on the kROCM provider

mudler
authored and
ghazni101
committed
657e04b
spec(BACKEND-ROCM): define Qwen3.5 gfx1100 numerical gate

VikashLoomba
authored and
ghazni101
committed
a13a577
spec(BACKEND-ROCM): repair Qwen3.5 numerical plan

VikashLoomba
authored and
ghazni101
committed
5da6e49
spec(BACKEND-ROCM): correct Qwen3.5 capture contracts

VikashLoomba
authored and
ghazni101
committed
8fbd504
perf(GFX1100-TG200): T4a MMVQ K-quant decode GEMV arm
ghazni101
committed
3b9c187
feat(GFX1100-TG200): lever-C fuses Q8_K activation quant into the RmsNorm epilogue
ghazni101
committed
1f41d00
T27: warp-cooperative QuantizeQ8KK for decode (+2.06%, byte-identical)
ghazni101
committed
4b2c9cc
feat(GFX1100-TG200): T24 LDS-buffered quant epilogue in RmsNormRowCoopKernel
ghazni101
committed
ce50ed5
feat(GFX1100-TG200): T21 keep-quant for V-head row-permuted GDN projections
ghazni101
committed
5c777c5
fix(rocm): gate the coop rmsnorm vector body to bf16 gamma, seed quant amax at 0
ghazni101
committed
577d327
T25: keep ssm_out as Q5_K with runtime input permutation
ghazni101
committed
2ef35e6
perf(GFX1100-TG200): T6b adds the warp-per-item cooperative attn preamble arm
ghazni101
committed
697e27b

Navigation Menu

perf(GFX1100-TG200): T6b cooperative attn preamble arm - #2868

perf(GFX1100-TG200): T6b cooperative attn preamble arm#2868
ghazni101 wants to merge 15 commits into
mudler:mainfrom
ghazni101:row/GFX1100-TG200-T6b

Commits on Sep 6, 2026

feat(KERNEL-QUANT-CIQ-GEMM-ROCM): land the W1 keep-quant providers on kROCM

fix(KERNEL-QUANT-CIQ-GEMM-ROCM): keep grouped Q8_0 on the kROCM provider

Revert "fix(KERNEL-QUANT-CIQ-GEMM-ROCM): keep grouped Q8_0 on the kROCM provider"

fix(KERNEL-QUANT-CIQ-GEMM-ROCM): keep grouped Q8_0 on the kROCM provider

spec(BACKEND-ROCM): define Qwen3.5 gfx1100 numerical gate

spec(BACKEND-ROCM): repair Qwen3.5 numerical plan

spec(BACKEND-ROCM): correct Qwen3.5 capture contracts

perf(GFX1100-TG200): T4a MMVQ K-quant decode GEMV arm

feat(GFX1100-TG200): lever-C fuses Q8_K activation quant into the RmsNorm epilogue

T27: warp-cooperative QuantizeQ8KK for decode (+2.06%, byte-identical)

feat(GFX1100-TG200): T24 LDS-buffered quant epilogue in RmsNormRowCoopKernel

feat(GFX1100-TG200): T21 keep-quant for V-head row-permuted GDN projections

fix(rocm): gate the coop rmsnorm vector body to bf16 gamma, seed quant amax at 0

T25: keep ssm_out as Q5_K with runtime input permutation

perf(GFX1100-TG200): T6b adds the warp-per-item cooperative attn preamble arm