(AI policy violation) Metal: TurboQuant GPU dequant kernels + host buffer type - #21818

Closed

sachmans wants to merge 7 commits into

ggml-org:masterfrom

sachmans:pr-turboquant-metal

Commits on Apr 8, 2026

feat: add CPU TurboQuant KV cache types

elusznik
authored and
sachmans
committed
1890e97
ggml : limit the first TurboQuant CPU PR to TBQ

elusznik
authored and
sachmans
committed
243fc44
ggml : fix TurboQuant CPU review issues

elusznik
authored and
sachmans
committed
67385c2
turboquant: use Apple Accelerate cblas_sgemv for 2x faster dequant
sachmans
committed
e3b22f0
turboquant: add norm correction to dequant for better quality
sachmans
committed
6a2e0ac
docs: add TurboQuant benchmarks and usage to README
sachmans
committed
17435f0

Commits on Apr 11, 2026

turboquant: add Metal GPU dequant kernels and host buffer type

sachmans
and
claude
committed
ab0b4d3