vllm/recipes at main · vllm-project/vllm · GitHub
Skip to content

Latest commit

 

History

History

recipes

Folders and files

README.md

vLLM model recipes

This directory holds the deployment recipes for models served by vLLM, one YAML per model at models/<hf_org>/<hf_repo>.yaml. The path mirrors the Hugging Face ID, so models/Qwen/Qwen3.8-27B.yaml renders at recipes.vllm.ai/Qwen/Qwen3.8-27B.

The site, the command builder, and the JSON API are built by vllm-project/recipes. That repository owns the schema and the shared vocabulary (hardware profiles, serving strategies, KV-offload deployments) and pins this directory to a commit. Omni (image, video, audio) recipes stay in vllm-project/recipes for now (moving to vllm-omni), and Ascend NPU content is inline in these recipes (moving to vllm-ascend overlays).

Editing a recipe

Start a new recipe from templates/recipe.yaml. Fields are defined in SCHEMA.md and checked against recipe.schema.json on every build; an unknown or misspelled key is an error. For completion and inline errors in YAML-aware editors, start the file with # yaml-language-server: $schema=https://recipes.vllm.ai/recipe.schema.json.

Follow the recipes repository's add-recipe skill for the schema and the validation steps. To validate a change exactly as this repository's Recipes PR check does, run from a checkout of vllm-project/recipes:

node scripts/validate-source.mjs --source vllm --dir ~/vllm/recipes

To preview the site with your changes, add a gitignored sources.local.yaml to that checkout with overrides: { vllm: ~/vllm/recipes } and run pnpm dev. This works once vllm-project/recipes reads this directory as its vllm source (vllm-project/recipes#1095).