Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.
You must be logged in to block users.
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
HTML
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Python 105k 32.5k
A high-throughput and memory-efficient inference and serving engine for LLMs
Python 94.8k 23.7k
FlashInfer: Kernel Library for LLM Serving
Cuda 6.7k 1.6k
Common recipes to run vLLM
JavaScript 1.1k 471
Performance benchmark & accuracy evaluation for vLLM
Python 17 23
There was an error while loading. Please reload this page.