Popular repositories Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 2 4

2. InferenceXCurve InferenceXCurve Public

   TypeScript 1 2

3. xFasterTransformer xFasterTransformer Public

   Forked from intel/xFasterTransformer

   C++

4. DeepCTR DeepCTR Public

   Forked from shenweichen/DeepCTR

   Easy-to-use,Modular and Extendible package of deep-learning based CTR models .

   Python

5. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python 1

6. aiter aiter Public

   Forked from ROCm/aiter

   AI Tensor Engine for ROCm

   Python