Skip to content

Pull requests: InternLM/lmdeploy

New pull request New
36 Open 1,272 Closed
36 Open 1,272 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix blocked fp8 moe kernel Bug:P1
#3009 opened Jan 10, 2025 by grimoire Loading…
Fix get_ppl & get_logits
#3008 opened Jan 9, 2025 by lvhan028 Loading…
1 task done
[WIP]: support-moe-fp8
#3007 opened Jan 9, 2025 by RunningLeon • Draft
support new backend cambricon
#3002 opened Jan 9, 2025 by JackWeiw • Draft
1
[CI] add daily testcase on 4090
#2998 opened Jan 8, 2025 by zhulinJulia24 Loading…
1
Expose spaces_between_special_tokens improvement
#2991 opened Jan 7, 2025 by AllentDan Loading…
[feature] add dlinfer w8a8 support.
#2988 opened Jan 4, 2025 by Reinerzhou • Draft
add block_size arg to chat api
#2986 opened Jan 3, 2025 by JackWeiw • Draft
3
[dlinfer]rope refine improvement
#2984 opened Jan 2, 2025 by JackWeiw Loading…
Log critical event of a request life cycle improvement
#2981 opened Dec 31, 2024 by lvhan028 Loading…
add internvl2.5-78b mmmu evaluation
#2980 opened Dec 31, 2024 by lvhan028 Loading…
[dlinfer]change llm op interface of paged_prefill_attention. improvement
#2977 opened Dec 31, 2024 by JackWeiw Loading…
1
Set max concurrent requests
#2961 opened Dec 26, 2024 by AllentDan Loading…
1
[maca] support deepseekv2 for maca backend. enhancement New feature or request
#2918 opened Dec 18, 2024 by Reinerzhou • Draft
[WIP]: use weights iterator while loading
#2886 opened Dec 12, 2024 by RunningLeon Loading…
support Turbomind ep enhancement New feature or request
#2883 opened Dec 12, 2024 by irexyc Loading…
Support Medusa speculative decoding enhancement New feature or request
#2859 opened Dec 5, 2024 by AllentDan Loading…
2
[maca] add cudagraph support on maca backend.
#2834 opened Nov 29, 2024 by Reinerzhou Loading…
1
Refactor turbomind attention by precomputing rotary embed improvement
#2801 opened Nov 25, 2024 by irexyc Loading…
11
[Feature] Support llava onevision enhancement New feature or request
#2783 opened Nov 21, 2024 by deepindeed2022 Loading…
22
support qwen2-vl with turbomind backend enhancement New feature or request
#2720 opened Nov 6, 2024 by irexyc Loading…
3
Run loop.run_until_complete in another thread improvement
#2701 opened Nov 4, 2024 by AllentDan Loading…
1
update pre-commit config
#2683 opened Oct 30, 2024 by lvhan028 Loading…
3
support release pipeline improvement
#2581 opened Oct 11, 2024 by irexyc Loading…
3
[Feature] Support vision module w8a8 inference improvement
#2308 opened Aug 14, 2024 by AllentDan Loading…
5
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.