Pinned Loading

1. microsoft/sarathi-serve microsoft/sarathi-serve Public

   A low-latency & high-throughput serving engine for LLMs

   Python 340 44

2. SSMLoRA SSMLoRA Public

   [NAACL'25] SSMLoRA: Enhancing Low-Rank Adaptation with State Space Model

   Python 10 1

3. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 78k 11.4k

4. hiyouga/LLaMA-Factory hiyouga/LLaMA-Factory Public

   Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

   Python 46.7k 5.7k

5. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 44.6k 6.8k

6. Open-DataFlow/RARE Open-DataFlow/RARE Public

   Official implementation of RARE: Retrieval-Augmented Reasoning Modeling [Work in Progress]

   Python 46 8