[Quantization] Support kimi-k3 routed expert quant by kylesayrs · Pull Request #57430 · vllm-project/vllm · GitHub
Skip to content

[Quantization] Support kimi-k3 routed expert quant - #57430

Merged
mgoin merged 2 commits into
vllm-project:mainfrom
neuralmagic:kylesayrs/support-kimi-routed-expert-quant
Sep 18, 2026
Merged

mgoin merged 2 commits into
vllm-project:mainfrom
neuralmagic:kylesayrs/support-kimi-routed-expert-quant

Conversation

@kylesayrs

@kylesayrs kylesayrs commented Sep 17, 2026 •

Copy link
Copy Markdown
Contributor

Background

  • Working on eeking out performance on kimi-k3, potentially by quantizing these moe linear adapter layers

Testing

  • Tested with RedHatAI/Kimi-K3-NVFP4-REAP25

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@mgoin

mgoin commented Sep 17, 2026

Copy link
Copy Markdown
Member

@mgoin mgoin added the verified Run pre-commit for new contributors without triggering other tests label Sep 17, 2026
@github-actions

Copy link
Copy Markdown

❌ This PR is 41 commits behind upstream main. Your branch must contain every commit currently on upstream main. No new CI build was started. Merge or rebase onto the latest main, then rerun /ci run. To test this branch at your own risk, use /ci run --allow-stale.

@mgoin

mgoin commented Sep 17, 2026

Copy link
Copy Markdown
Member

/ci run

@github-actions

Copy link
Copy Markdown

@mgoin
mgoin merged commit 76d517f into vllm-project:main Sep 18, 2026
83 checks passed
michael-gpu pushed a commit to practical-inference/vllm-ampere-extended that referenced this pull request Oct 20, 2026
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

k3 kimi quantization verified Run pre-commit for new contributors without triggering other tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants