6 Pull requests merged by 2 people

• Minor performance improvements

  #179 merged Jan 27, 2025

• Interleave 8 rows (Q8_0, IQ4_XS)

  #178 merged Jan 27, 2025

• Update chat templates

  #177 merged Jan 24, 2025

• Deepseek V3 support added

  #176 merged Jan 23, 2025

• Better BF16 support on AVX2

  #175 merged Jan 22, 2025

• On Zen4 repack fp16 models to bf16_r16

  #174 merged Jan 21, 2025

1 Unresolved conversation

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Trellis quantization

  #113 commented on Jan 24, 2025 • 0 new comments