Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Which image base model you used in pyramidflow-miniflux #226

Open
guyuchao opened this issue Dec 29, 2024 · 5 comments
Open

Which image base model you used in pyramidflow-miniflux #226

guyuchao opened this issue Dec 29, 2024 · 5 comments

Comments

@guyuchao
Copy link

guyuchao commented Dec 29, 2024

The transformer config of pyramidflow-miniflux is different from flux.1. How you adapt the flux.1 to this smaller version.

@guyuchao guyuchao changed the title Which image base model Which image base model you used in pyramidflow-miniflux Dec 29, 2024
@guyuchao guyuchao reopened this Dec 29, 2024
@feifeiobama
Copy link
Collaborator

we reduced the width & #layers in FLUX.1 and trained it from scratch.

@guyuchao
Copy link
Author

Do you mean you only adopt the flux structure but not its pretrained weights?

@feifeiobama
Copy link
Collaborator

yes :)

@guyuchao
Copy link
Author

have you pre-trained a t2i model yourself, or directly train a t2v model from scratch?

@feifeiobama
Copy link
Collaborator

regarding the released checkpoint, we first pre-trained a t2i model and then perform image-video joint training for the t2v model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants