Pinned Loading

1. LMCache/LMCache LMCache/LMCache Public

   LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

   Python 12.2k 2.1k

2. pytorch/pytorch pytorch/pytorch Public

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python 105k 32.3k

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 95.3k 23.9k

4. deepspeedai/DeepSpeed deepspeedai/DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 43.3k 5.1k