Pull requests

• perf(sm120): optimize DeepSeek-V4.1 inference

  #1788·AlpinDale opened Oct 21, 2026Member·

  ·
  1

• fix(ci): guard empty commits[@] expansion in reconcile_platform_wheels.sh

  #1784·Nakanokensetsu opened Sep 11, 2026Contributor·

  ·
  1

• fix(exl3): clamp out-of-range expert ids in MoE prefill scatter path

  #1782·Nakanokensetsu opened Sep 9, 2026Contributor·

  ·

• Support for logit bias in specdec

  #1717·50h100a opened Jul 23, 2026Collaborator·

  ·
  1

• Don't disable other samplers for non-mirostat rows in a mixed batch

  #1674·lollinng opened Jun 5, 2026·

  ·

• [kernel][mobile] add mobile-optimized CPU backend

  #1609·AlpinDale opened Nov 15, 2025Member·

  ·
  10

• [kernel][moe] better splitK for fused moe

  #1603·AlpinDale opened Nov 5, 2025Member·

  ·
  2

• [kernel] feat: hybrid CPU-GPU MoE inference

  #1550·AlpinDale opened Nov 2, 2025Member·

  ·

• Allow to force p2p

  #1546·Nero10578 opened Oct 17, 2025Contributor·

  ·
  3

• [API] feat: add reasoning recovery mechanism

  #1541·AlpinDale opened Oct 3, 2025Member·

  ·
  6

• [Build] feat: multi-backend build system to consolidate CUDA, ROCm, CPU, etc

  #1540·AlpinDale opened Sep 29, 2025Member·

  ·
  5

• [Kernel][Comms] feat: add custom all-gather kernels

  #1524·AlpinDale opened Sep 19, 2025Member·

  ·
  7

• feat(compilation): Extend sequence parallelism to activations

  #1523·AlpinDale opened Sep 18, 2025Member·

  ·
  3

• [Kernel][Quantization] feat: add Gluon kernels for AWQ quantization

  #1520·AlpinDale opened Sep 17, 2025Member·

  ·

• [Kernel] feat: sage attention support

  #1513·AlpinDale opened Sep 12, 2025Member·

  ·

• fix: illegal memory access for FP8 MoE models in cutlass 3x grouped gemm kernel

  #1446·AlpinDale opened Aug 28, 2025Member·

  ·

• [Kernel] feat: add custom CUDA kernels for all sampling ops

  #1444·AlpinDale opened Aug 26, 2025Member·

  ·

• [Kernel][Experimental] feat: add Vulkan backend

  #1416·AlpinDale opened Aug 14, 2025Member·2 of 11 tasks·

  ·

• gguf: optimize prefill speeds for Q4_K quants

  #1395·AlpinDale opened Jul 18, 2025Member·

  ·

• Fix metrics and allow disable block manager v2

  #1299·Nero10578 opened Apr 15, 2025Contributor·

  ·
  1

• [WIP] feat: sampler plugin system

  #1124·AlpinDale opened Feb 6, 2025Member·

  ·

• VLM: add support for SwinV2 ViT

  #1107·AlpinDale opened Jan 27, 2025Member·

  ·

• [Kernel] Add support for FLUTE quantization

  #1088·AlpinDale opened Jan 18, 2025Member·2 tasks·

  ·

• Reduce peak memory for prompt_logprobs requests

  #907·50h100a opened Dec 16, 2024Collaborator·

  ·
  1

• Add Repetition Range ('rep_range')

  #888·discordianbelle opened Dec 14, 2024Contributor·

  ·
  19