Skip to content

gguf: optimize prefill speeds for Q4_K quants - #1395

Open
AlpinDale wants to merge 3 commits into
mainfrom
q4k_prefill_optim
Open

AlpinDale wants to merge 3 commits into
mainfrom
q4k_prefill_optim

Commits

Commits on Jul 18, 2025