Pinned Loading

1. microsoft/sarathi-serve microsoft/sarathi-serve Public

   A low-latency & high-throughput serving engine for LLMs

   Python 319 41

2. SSMLoRA SSMLoRA Public

   [NAACL'25] SSMLoRA: Enhancing Low-Rank Adaptation with State Space Model

   Python 8 1

3. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 76.6k 11.1k

4. hiyouga/LLaMA-Factory hiyouga/LLaMA-Factory Public

   Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

   Python 44.2k 5.4k

5. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 41.5k 6.3k

6. meta-llama/llama-cookbook meta-llama/llama-cookbook Public

   Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama mode…

   Jupyter Notebook 16.5k 2.4k