Search results

[BUG] too much overhead even for a 1b instruct model

bugSomething isn't workingSomething isn't working

Status: Open.

#1277 In ModelTC/LightLLM;

· JINO-ROHIT opened on Apr 18, 2026

[BUG] add support for uv

bugSomething isn't workingSomething isn't working

Status: Open.

#1270 In ModelTC/LightLLM;

· JINO-ROHIT opened on Apr 15, 2026

deepseekv3 开启 tp + ep 的混合模式的时候，精度会下降。

Status: Open.

#1223 In ModelTC/LightLLM;

· hiworldwzj opened on Mar 10, 2026

CVE-2026-26220: Unauthenticated RCE via Pickle Deserialization in PD WebSocket Endpoints

Status: Open.

#1213 In ModelTC/LightLLM;

· Chocapikk opened on Feb 15, 2026

[BUG]按照官方脚本，源代码安装失败

bugSomething isn't workingSomething isn't working

Status: Open.

#1179 In ModelTC/LightLLM;

· bluemoon-o2 opened on Jan 14, 2026

PD分离部署DeepSeeK-R1-FP8模型，起tp16卡的prefill服务报错

Status: Open.

#1074 In ModelTC/LightLLM;

· wenruihua opened on Sep 30, 2025

[BUG] silu_and_mul_masked UT failed

bugSomething isn't workingSomething isn't working

Status: Open.

#1068 In ModelTC/LightLLM;

· froststeam opened on Sep 25, 2025

where can I find lightllm_constraint_decode_kernel?

Status: Open.

#1007 In ModelTC/LightLLM;

· Gompyn opened on Aug 15, 2025

lightllm_kernels有计划什么时候开源吗

Status: Open.

#976 In ModelTC/LightLLM;

· danielhua23 opened on Jul 21, 2025

add AI/ML API as provider

Status: Open.

#929 In ModelTC/LightLLM;

· OctavianTheI opened on Jun 12, 2025

希望支持静态量化模型（AWQ/GPTQ，配合llmc）的加载与推理

Status: Open.

#894 In ModelTC/LightLLM;

· poisonwine opened on May 14, 2025

add docs for multimodal models.

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#852 In ModelTC/LightLLM;

· hiworldwzj opened on Apr 23, 2025