Search results

Large PPL Fluctuations in VPTQ 4.05-bit Quantization Despite Fixed Random Seed and Identical Setup

Status: Open.

#202 In microsoft/VPTQ;

· Qingtian-Liu opened on Nov 13, 2025

"ValueError: Expected 1 columns but got 8 columns." when quantizing Llama3.2-1B

Status: Open.

#201 In microsoft/VPTQ;

· SunXT-0719 opened on Oct 21, 2025

How does the inference speed of VPTQ-3bit compare to AWQ-4bit?

Status: Open.

#200 In microsoft/VPTQ;

· LiMa-cas opened on Sep 3, 2025

qwen3 support

Status: Open.

#197 In microsoft/VPTQ;

· LiMa-cas opened on Jul 7, 2025

a version incompatibility issue

Status: Open.

#196 In microsoft/VPTQ;

· Zn0425 opened on May 22, 2025

Can you provide a script that can reproduce the results of the paper?

Status: Open.

#191 In microsoft/VPTQ;

· xuzukang opened on Mar 26, 2025

gemma-3 support

Status: Open.

#188 In microsoft/VPTQ;

· ZanePoe opened on Mar 17, 2025

Question about result reproduction

Status: Open.

#180 In microsoft/VPTQ;

· searchthe opened on Mar 6, 2025

when contribute VPTQ to llm compressor?

Status: Open.

#176 In microsoft/VPTQ;

· geqian-9192 opened on Feb 14, 2025

DeepSeek-R1 support

new modelsrequire new modelsrequire new models

Status: Open.

#174 In microsoft/VPTQ;

· loretoparisi opened on Feb 7, 2025

Question about fine-tuning

alogrithm

enhancementNew feature or requestNew feature or request

questionFurther information is requestedFurther information is requested

Status: Open.

#136 In microsoft/VPTQ;

· kimwin2 opened on Dec 3, 2024

How to dequantize a model with 4 groups and centroids greater than 4096?

bugSomething isn't workingSomething isn't working

questionFurther information is requestedFurther information is requested

Status: Open.

#128 In microsoft/VPTQ;

· ShawnzzWu opened on Nov 29, 2024