We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.
You must be logged in to block users.
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉
Cuda 10.7k 1.1k
🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉
C++ 4.4k 777
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
Python 3.7k 740
SGLang is a high-performance serving framework for large language models and multimodal models.
Python 26.3k 5.5k
A PyTorch-native inference engine with cache, parallelism, quantization for Diffusion Transformers.
Python 1.2k 69
FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA.
Cuda 272 16
There was an error while loading. Please reload this page.