Skip to content

[Bugfix][SM70/SM75] Honor a checkpoint's KV-cache quantization directive only on Ampere and newer - #613

Open
Peuqui wants to merge 1 commit into
1CatAI:mainfrom
Peuqui:kv-quant-policy-pre-ampere
Open

Peuqui wants to merge 1 commit into
1CatAI:mainfrom
Peuqui:kv-quant-policy-pre-ampere

[Bugfix][SM70/SM75] Honor a checkpoint's KV-cache quantization direct…

8c98b85
Select commit
Loading
Failed to load commit list.
Sign in for the full log view