Add `LGAI-EXAONE-3.5` model by sadra-barikbin · Pull Request #744 · predibase/lorax · GitHub
Skip to content
This repository was archived by the owner on Oct 12, 2026. It is now read-only.

Add LGAI-EXAONE-3.5 model - #744

Open
sadra-barikbin wants to merge 1 commit into
predibase:mainfrom
sadra-barikbin:Feature-add-exaone-model
Open

sadra-barikbin wants to merge 1 commit into
predibase:mainfrom
sadra-barikbin:Feature-add-exaone-model

Conversation

@sadra-barikbin

@sadra-barikbin sadra-barikbin commented Jan 20, 2025 •

Copy link
Copy Markdown

Hi there!

To add LGAI-EXAONE-3.5 model support to Lorax.

I tested the result against the vLLM counterpart + an LoRA adapter and seemingly they were the same.
Update on the above sentence: Sometimes they were the same and sometimes that of the vLLM changed.

flash_exaone_modeling is inspired by flash_cohere_modeling, flash_llama_modeling and also the custom model code in the model HF repo.

Fixes #743

This branch has not been deployed

No deployments
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add model LGAI-EXAONE/EXAONE

1 participant