Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some question about the code of textsliders "train_lora_xl.py" #101

Open
yatoubusha opened this issue Jul 26, 2024 · 0 comments
Open

Some question about the code of textsliders "train_lora_xl.py" #101

yatoubusha opened this issue Jul 26, 2024 · 0 comments

Comments

@yatoubusha
Copy link

I observed that during the training process, firstly, based on the Lora structure, we infer denoised_latents from randomly initialized latents,
image
image
Then, based on denoised_latents and the frozen SD structure, continue to predict noise? denoised_latents is already the denoised image, what is the principle of predicting noise again? Why not predict noise for randomly initialized latents?
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant