Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add community pipeline for semantic guidance for FLUX #10610

Open
wants to merge 8 commits into
base: main
Choose a base branch
from

Conversation

Marlon154
Copy link

What does this PR do?

This PR adds the new FluxSemanticGuidancePipeline to enable semantic guidance (original paper) capabilities in the Flux model family. Works like already existing semantic guidance pipelines.
Example on usage is in the doc string, it works with:

  • FLUX adapters
  • Multiple images per prompt
  • Multiple prompts
  • CFG with negative prompt
  • Without CFG

Examples

Prompt Original Edit Edited
A cat holding a sign that says hello world Original remove "cat", add "dog" Edited
race car on a track image-original-2 add "black sports car" image-edit-2
A sports car under a tree. (with adapter) adapter_orginal add "apple tree", add "dog sitting on the right side of a car" adapter_edit

Before submitting

Who can review?

@linoytsaban

@linoytsaban linoytsaban self-assigned this Jan 20, 2025
@Marlon154 Marlon154 force-pushed the sega-flux-community branch from 8e42936 to a5892d7 Compare January 20, 2025 12:22
Copy link
Collaborator

@linoytsaban linoytsaban left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great work, thanks @Marlon154!

@linoytsaban linoytsaban requested a review from hlky January 21, 2025 11:04
Copy link
Collaborator

@hlky hlky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

examples/community/pipeline_flux_semantic_guidance.py Outdated Show resolved Hide resolved
examples/community/pipeline_flux_semantic_guidance.py Outdated Show resolved Hide resolved
examples/community/pipeline_flux_semantic_guidance.py Outdated Show resolved Hide resolved
@Marlon154
Copy link
Author

@hlky implemented requested changes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants