[Bugfix][SM70/SM75] Honor a checkpoint's KV-cache quantization directive only on Ampere and newer - #613
Open
Peuqui wants to merge 1 commit into
Open
[Bugfix][SM70/SM75] Honor a checkpoint's KV-cache quantization directive only on Ampere and newer#613Peuqui wants to merge 1 commit into
Peuqui wants to merge 1 commit into
background
wait
wait-all
cancel
parallel
Loading