This repository was archived by the owner on Mar 21, 2026. It is now read-only.

Repository navigation

All pull requests

Labels (14)Milestones (1)

Remove dead bitsandbytes CxB code from 8-bit inference path
#3356TimDettmers opened Feb 16, 20261 task
test(config): add comprehensive tests for router config utilities
#3349yurekami opened Dec 27, 20252 tasks
Upgrade GitHub Actions to latest versions
#3348salmanmkc opened Dec 20, 2025
Upgrade GitHub Actions for Node 24 compatibility
#3347salmanmkc opened Dec 20, 2025
fix: don't use kernel layernorm on Blackwell architecture to avoid "no kernel image" error
#3343AdamPalaxo opened Dec 11, 20251 of 5 tasks
feat: prefer latest outlines core and compile grammar in router
#3340drbh opened Nov 14, 2025Collaborator
fix: bump flake and update grammar logit processor
#3338drbh opened Nov 6, 2025Collaborator
feat: expose GPU energy consumption (mJ) in responses
#3315JulienDelavande opened Aug 28, 20252 of 5 tasks
1
Add dedicated CPU-only Dockerfile and update documentation for CPU/…
#3310jakubgajski opened Aug 7, 20252 of 5 tasks
support qwen3 on nvidia
#3302icyxp opened Jul 23, 2025Contributor
4
Retrieve the correct cached model batch size in Neuron config checker for Neuron Backend
#3300jimburtoft opened Jul 19, 20253 tasks
Attempt to fix CI errors
#3292danieldk opened Jul 8, 2025Member5 tasks
fix: enable defs references in tool calls
#3291drbh opened Jul 7, 2025Collaborator
Update quantization kernels
#3288danieldk opened Jul 7, 2025Member5 tasks
feat: allow json_schema in response format and add test
#3276drbh opened Jun 25, 2025Collaborator
3
Disable mamba in CPU platform
#3266casassg opened Jun 13, 20253 of 5 tasks
feat: improve llava next pooling for granite vision
#3255drbh opened Jun 4, 2025Collaborator
Trtllm backend improvements
#3231leejuyuu opened May 17, 20251 of 5 tasks
3
Fix typos
#3210omahs opened May 6, 20251 of 5 tasks
feat: lock updated kernel versions
#3201drbh opened Apr 29, 2025Collaborator
Set uv UV_PYTHON_INSTALL_DIR explicitly
#3197sebastianliebscher opened Apr 27, 20251 of 5 tasks
2
README: minimum Python version is 3.10
#3194Frenzie opened Apr 25, 20251 of 5 tasks
feat: support logit bias in chat request
#3186drbh opened Apr 22, 2025Collaborator
29
Fix flashinfer plan call to use positional arguments for #3165
#3166ruckc opened Apr 11, 20252 of 5 tasks
1
Update to flashinfer 0.2.5
#3164danieldk opened Apr 11, 2025Member5 tasks

Sunbelt Computer Software

PL/B Language Development and Support

Navigation Menu

Repository navigation

All pull requests

Remove dead bitsandbytes CxB code from 8-bit inference path

test(config): add comprehensive tests for router config utilities

Upgrade GitHub Actions to latest versions

Upgrade GitHub Actions for Node 24 compatibility

fix: don't use kernel layernorm on Blackwell architecture to avoid "no kernel image" error

feat: prefer latest outlines core and compile grammar in router

fix: bump flake and update grammar logit processor

feat: expose GPU energy consumption (mJ) in responses

Add dedicated CPU-only Dockerfile and update documentation for CPU/…

support qwen3 on nvidia

Retrieve the correct cached model batch size in Neuron config checker for Neuron Backend

Attempt to fix CI errors

fix: enable defs references in tool calls

Update quantization kernels

feat: allow json_schema in response format and add test

Disable mamba in CPU platform

feat: improve llava next pooling for granite vision

Trtllm backend improvements

Fix typos

feat: lock updated kernel versions

Set `uv` UV_PYTHON_INSTALL_DIR explicitly

README: minimum Python version is 3.10

feat: support logit bias in chat request

Fix flashinfer plan call to use positional arguments for #3165

Update to flashinfer 0.2.5

Sunbelt Computer Software

PL/B Language Development and Support

Pull requests