[BUG] too much overhead even for a 1b instruct model · Issue #1277 · ModelTC/LightLLM · GitHub
Skip to content

[BUG] too much overhead even for a 1b instruct model #1277

Open
Open
[BUG] too much overhead even for a 1b instruct model#1277
Labels
bugSomething isn't working

Description

@JINO-ROHIT
JINO-ROHIT
opened on Apr 18, 2026

im trying to run 1b instruct model on a 16gb vram gpu, it still fails to start up

Activity

  1. JINO-ROHIT
    added
    bugSomething isn't working
    on Apr 18, 2026

  2. hiworldwzj commented on Apr 21, 2026

    @hiworldwzj
    hiworldwzj
    on Apr 21, 2026
    Collaborator

    @JINO-ROHIT detail log ？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions