Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 95.3k 23.9k

2. dlrover dlrover Public template

   Forked from intelligent-machine-learning/dlrover

   DLRover: An Automatic Distributed Deep Learning System

   Python

3. LMCache LMCache Public

   Forked from LMCache/LMCache

   Supercharge Your LLM with the Fastest KV Cache Layer

   Python

4. Mooncake Mooncake Public

   Forked from kvcache-ai/Mooncake

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++

5. verl verl Public

   Forked from verl-project/verl

   verl: Volcano Engine Reinforcement Learning for LLMs

   Python

6. flagos-ai/FlagCX flagos-ai/FlagCX Public

   FlagCX is a scalable and adaptive cross-chip communication library.

   C++ 258 79