UnCLIP Image Interpolation -> Keep same initial noise across interpolation steps by Abhinay1997 · Pull Request #3782 · huggingface/diffusers · GitHub
Skip to content

UnCLIP Image Interpolation -> Keep same initial noise across interpolation steps - #3782

Merged
patrickvonplaten merged 3 commits into
huggingface:mainfrom
Abhinay1997:unclip_image_fixes
Jun 15, 2023
Merged

patrickvonplaten merged 3 commits into
huggingface:mainfrom
Abhinay1997:unclip_image_fixes

Conversation

@Abhinay1997

Copy link
Copy Markdown
Contributor

This change is more in line with the DallE-2 paper which describes:

The second option (for image interpolation) involves fixing the DDIM latent to a randomly-sampled value for all interpolates in the trajectory. This results in an infinite number of trajectories between x1 and x2, though the endpoints of these trajectories will generally no longer coincide with the original images.

@HuggingFaceDocBuilderDev

HuggingFaceDocBuilderDev commented Jun 14, 2023 •

Copy link
Copy Markdown

@patrickvonplaten

Copy link
Copy Markdown
Contributor

@patrickvonplaten
patrickvonplaten merged commit 231bdf2 into huggingface:main Jun 15, 2023
AmericanPresidentJimmyCarter pushed a commit to AmericanPresidentJimmyCarter/diffusers that referenced this pull request Apr 26, 2024
…ation steps (huggingface#3782)

* Maintain same decoder start noise for all interp steps

* Correct comment

* use batch_size for consistency
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants