Skip to content

feat: TurboQuant KV cache (TBQ3_0/TBQ4_0) with CPU + CUDA support - #21

Merged
marksverdhei merged 10 commits into
htfrom
feat/turboquant-kv-cache
Mar 31, 2026
Merged

marksverdhei merged 10 commits into
htfrom
feat/turboquant-kv-cache

fix(turboq): free d_turboq_norms buffer in cleanup to prevent memory …

c9b66da
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs