Search results

Total parameters are less after quantization

Status: Open.

#291 In qwopqwop200/GPTQ-for-LLaMa;

· ZN1010 opened on Dec 21, 2024

add support for minicpm

Status: Open.

#289 In qwopqwop200/GPTQ-for-LLaMa;

· LDLINGLINGLING opened on Jul 4, 2024

GPTQ vs bitsandbytes

Status: Open.

#288 In qwopqwop200/GPTQ-for-LLaMa;

· iaoxuesheng opened on Apr 5, 2024

Error when load GPTQ model

Status: Open.

#287 In qwopqwop200/GPTQ-for-LLaMa;

· KyrieCui opened on Feb 12, 2024

datasets.utils.info_utils.ExpectedMoreSplits: {'validation'}

Status: Open.

#286 In qwopqwop200/GPTQ-for-LLaMa;

· SDcodehub opened on Jan 10, 2024

Syntax changed in triton.testing.do_bench() causing error when running llama_inference.py

Status: Open.

#285 In qwopqwop200/GPTQ-for-LLaMa;

· prasanna opened on Dec 10, 2023

Support Mistral.

Status: Open.

#284 In qwopqwop200/GPTQ-for-LLaMa;

· nbollman opened on Oct 14, 2023

error: block with no terminator, has llvm.cond_br %5624, ^bb2, ^bb3

Status: Open.

#283 In qwopqwop200/GPTQ-for-LLaMa;

· Hukongtao opened on Sep 19, 2023

neox.py needs to add "import math"

Status: Open.

#282 In qwopqwop200/GPTQ-for-LLaMa;

· StudyingShao opened on Aug 14, 2023

LoRa and diff with bitsandbytes

Status: Open.

#281 In qwopqwop200/GPTQ-for-LLaMa;

· RonanKMcGovern opened on Aug 3, 2023

Transformers broke again (AttributeError: 'GPTQ' object has no attribute 'inp1')

Status: Open.

#280 In qwopqwop200/GPTQ-for-LLaMa;

· EyeDeck opened on Jul 29, 2023

Can i quantize HF version of llama model

Status: Open.

#279 In qwopqwop200/GPTQ-for-LLaMa;

· akanyaani opened on Jul 26, 2023