[staging CI] unslothai/unsloth#14510 by danielhanchen · Pull Request #508 · Imagineer99/unsloth · GitHub
Skip to content

[staging CI] unslothai/unsloth#14510 - #508

Closed
danielhanchen wants to merge 2 commits into
upstream-mainfrom
pr-14510-ci
Closed

danielhanchen wants to merge 2 commits into
upstream-mainfrom
pr-14510-ci

Conversation

@danielhanchen

Copy link
Copy Markdown
Collaborator

Disposable CI run for unslothai#14510. Do not merge; closed after CI.

An fp8 or fp8_scaled ComfyUI Krea 2 file (13 GB) on a GPU with no fp8 runtime
is widened to bf16 in host RAM (about 26 GB) before the denoiser is placed.
With too little free memory the process was killed (Linux OOM killer, Windows
commit limit), taking the whole app down instead of failing the load.

Price the new host memory from the safetensors header (tensors already at the
compute dtype stay memory-mapped and cost nothing) and refuse with a readable
message before any widening, in both the original-layout loader and the
ComfyUI-quantized loader. UNSLOTH_DIFFUSION_HOST_RAM_CHECK=0 skips the check.
@danielhanchen
danielhanchen deleted the pr-14510-ci branch October 21, 2026 17:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant