Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请问训练的时候,怎么训练? #208

Open
henbucuoshanghai opened this issue Dec 6, 2024 · 1 comment
Open

请问训练的时候,怎么训练? #208

henbucuoshanghai opened this issue Dec 6, 2024 · 1 comment

Comments

@henbucuoshanghai
Copy link

训练的时候,三阶段怎么划分的?依旧三阶段?0-0.3第一个?0.3-0.6第二个?不同阶段的dit输出后上采样进下一个stage?
感谢

@feifeiobama
Copy link
Collaborator

feifeiobama commented Dec 7, 2024

  • The $K$ time windows are simply divided with uniformly spaced endpoints, namely $e_k=1-\frac{k}{K}$. According to Equation (26) in the paper, these time windows are $[s_k,e_k]=\big[\frac{K-k-1}{K+k+1}, 1-\frac{k}{K}\big]$. For $K=3$, these time windows are $\big[0,\frac{1}{3}\big],\big[\frac{1}{5},\frac{2}{3}\big],\big[\frac{1}{2},1\big]$.
  • During training, the loss is directly computed by Equations (9-11) in the paper. During inference, we upsample and renoise the output from previous stage, according to Equation (15) in the paper.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants