Issues

• Question about sampling 256 samples for C4 dataset evaluation

  IST-DASLab/gptq#65 · Filter by author nku-ligl opened on Mar 19, 2026

• Responsible disclosure policy

  IST-DASLab/gptq#64 · Filter by author benharvie opened on Mar 8, 2026

• Why is the accuracy rate of the assessment I conducted using lm-evaluation-harnessing very low?

  IST-DASLab/gptq#63 · Filter by author BugBusterMax opened on Jul 29, 2025

• Sensitivity analysis of model parameters

  IST-DASLab/gptq#60 · Filter by author shengqihailuo1 opened on Jan 16, 2025

• Problem about value range of valenc in func get_c4()

  IST-DASLab/gptq#59 · Filter by author 88099981 opened on Nov 13, 2024
  2

• Reproducing Table3.

  IST-DASLab/gptq#57 · Filter by author mjyun01 opened on Oct 10, 2024

• Test on CNN model containing group conv by GPTQ method

  IST-DASLab/gptq#56 · Filter by author xd1073321804 opened on May 23, 2024

• Reconstruct Quantized Model Layer in torch.

  IST-DASLab/gptq#55 · Filter by author puja93 opened on May 19, 2024

• GPTQ on BERT based

  IST-DASLab/gptq#53 · Filter by author zhanyil2 opened on Feb 13, 2024

• AssertionError

  IST-DASLab/gptq#52 · Filter by author GuoYi0 opened on Jan 30, 2024

• Regarding the method for computing the Hessian matrix.

  IST-DASLab/gptq#51 · Filter by author baisonmg opened on Dec 29, 2023
  1

• GPTQ pseudo-quantization saved weights (pt format) How load Re-evaluation

  IST-DASLab/gptq#50 · Filter by author CXiaorong opened on Dec 21, 2023

• GPTQ转化的INT8模型，如何运行呢？请大佬指教

  IST-DASLab/gptq#49 · Filter by author xxm1668 opened on Dec 13, 2023

• Compatibility of Quant3Linear and 4-bit quantization

  IST-DASLab/gptq#48 · Filter by author mynotwo opened on Dec 10, 2023

• act-order on inference

  IST-DASLab/gptq#47 · Filter by author frankxyy opened on Dec 3, 2023

• running speed slow on NVIDIA vGPU

  IST-DASLab/gptq#45 · Filter by author foricee opened on Nov 11, 2023

• Use modified Cholesky decomposition instead of regularized Cholesky

  IST-DASLab/gptq#41 · Filter by author jiahao opened on Aug 7, 2023

• Why is the wikitext-2 ppl calculated in the code lower than the ppl by lm-evaluation-harness?

  IST-DASLab/gptq#40 · Filter by author Chocolife-96 opened on Aug 6, 2023

• LAMBADA evaluation accuracy

  IST-DASLab/gptq#39 · Filter by author kayhanbehdin opened on Aug 5, 2023

• How should I verify the speedup effect of the algorithm?

  IST-DASLab/gptq#38 · Filter by author moonlightian opened on Jul 20, 2023

• How to run the quantized model for perditions on my prompts?

  IST-DASLab/gptq#37 · Filter by author tarunmcom opened on Jul 18, 2023

• How can we use this lib to quantize Falcon7b / 40b models?

  IST-DASLab/gptq#36 · Filter by author tarunmcom opened on Jul 17, 2023

• How to adopt GPTQ on Conv2d with groups attribute?

  IST-DASLab/gptq#35 · Filter by author TMYuan opened on Jul 14, 2023
  1

• PPL results on wikitext/ptb/c4 are worse than the official result

  IST-DASLab/gptq#34 · Filter by author xingyueye opened on Jul 6, 2023
  2

• quant_cuda_kernel.cu(212): error: identifier "__hfma2" is undefined

  IST-DASLab/gptq#23 · Filter by author HueCheng1021 opened on May 11, 2023
  1