Popular repositories Loading

1. vllm-rlt vllm-rlt Public

   vllm based inference engine for looped transformer

   Python 199 30

2. system1-omni system1-omni Public

   community maintained vllm/vllm-omni style inference engine for system1 models in Rust for extreme efficient performance

   Rust 61 14

3. InferRSI InferRSI Public

   Python 43 7

4. vllm-omni-mlx vllm-omni-mlx Public

   High-performance OpenAI and Anthropic compatible omni-modality model inference server for Apple Silicon.

   Python 26 4

5. InferMatrixCopilot InferMatrixCopilot Public

   Copilot of JiusiServe sub repos

   Python 17 7

6. qwen3-tts-rsi-npu-engine qwen3-tts-rsi-npu-engine Public

   Fast qwen3-tts inference using RSI

   Python 12