Pinned Loading

1. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 118k 19.9k

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 84.3k 18.5k

3. opendatalab/MinerU opendatalab/MinerU Public

   Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.

   Python 69.4k 5.9k

4. ggml-org/ggml ggml-org/ggml Public

   Tensor library for machine learning

   C++ 14.9k 1.7k

5. k2-fsa/sherpa-onnx k2-fsa/sherpa-onnx Public

   Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Andr…

   C++ 13.2k 1.5k

6. intel/ipex-llm intel/ipex-llm Public archive

   Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discr…

   Python 8.8k 1.4k