You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 4630dd7
Browse filesBrowse the repository at this point in the historyBrowse files
feat: FlashPack support for transformers pipeline components
use_flashpack=True previously applied only to diffusers models;
transformers components (text encoders) silently kept safetensors, so
pipelines were never FlashPack end to end.
On save, pack transformers components' weights to model.flashpack the
same way ModelMixin.save_pretrained(use_flashpack=True) does. On load,
when a transformers component folder ships a flashpack file, initialize
the model from its config on empty weights and assign the packed
weights onto it, mirroring the existing diffusers-model FlashPack path.
Folders without a flashpack file keep loading exactly as before, so
existing mixed-format repos are unaffected.
"FlashPack `device_map` should not be one of `auto`, `balanced`, `balanced_low_0`, `sequential`. Use a specific device instead, e.g., `device_map='cuda'` or `device_map='cuda:0'"
0 commit comments