Skip to content

Issues: crabml/crabml

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

27 Open 45 Closed
27 Open 45 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

vulkan: add shaders for batched_gemv and bmm
#188 opened May 18, 2024 by flaneur2020
@flaneur2020
vulkan: add shaders for rms_norm, softmax, rope
#187 opened May 18, 2024 by flaneur2020
@flaneur2020
vulkan: add arithmetic operations
#186 opened May 18, 2024 by flaneur2020
@flaneur2020
Add vulkan backend
#185 opened May 18, 2024 by flaneur2020
3 tasks
@flaneur2020
Add OpenELM support
#183 opened Apr 24, 2024 by flaneur2020
Rotary KV cache
#180 opened Apr 18, 2024 by flaneur2020
Any speed testment?
#178 opened Apr 15, 2024 by lucasjinreal
1
Support RISC-V SIMD in Q4_1
#173 opened Apr 12, 2024 by flaneur2020
Support RISC-V SIMD in Q4_0
#172 opened Apr 12, 2024 by flaneur2020
NEON SIMD in Q5_1 good first issue Good for newcomers
#171 opened Apr 12, 2024 by flaneur2020
Neon SIMD in Q5_0 good first issue Good for newcomers
#170 opened Apr 12, 2024 by flaneur2020
@gobraves
2
Support RISC-V SIMD in Q8_0
#169 opened Apr 12, 2024 by flaneur2020
AVX2 SIMD in Q5_1 good first issue Good for newcomers
#162 opened Apr 8, 2024 by flaneur2020
Tracking: SIMD vec_dot in basic quantization formats
#158 opened Apr 8, 2024 by flaneur2020
5 of 11 tasks
Tracking: support more models
#157 opened Apr 7, 2024 by flaneur2020
support repeat_penalty config good first issue Good for newcomers
#153 opened Apr 6, 2024 by flaneur2020
1
Support Qwen models
#151 opened Mar 31, 2024 by flaneur2020
@flaneur2020
1
Support Yi models good first issue Good for newcomers
#148 opened Mar 31, 2024 by flaneur2020
use sparsity
#109 opened Mar 13, 2024 by flaneur2020
crabml.js good first issue Good for newcomers
#108 opened Mar 12, 2024 by flaneur2020
1
Support CLIP model
#106 opened Mar 12, 2024 by flaneur2020
Add starcoder2 support good first issue Good for newcomers
#70 opened Mar 4, 2024 by flaneur2020
Tracking: support batched prefilling in the llama2 model
#68 opened Mar 4, 2024 by flaneur2020
2 of 3 tasks
@flaneur2020
4
Add test for different quantization
#67 opened Mar 3, 2024 by Xuanwo
@Xuanwo
5
support Q8_0 quantization on GPU backend enhancement New feature or request
#62 opened Mar 3, 2024 by flaneur2020
@flaneur2020
1
ProTip! Exclude everything labeled bug with -label:bug.