You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I've got an art style LoRA and a concept LoRA with clothes. I'm trying to combine them, applying the style to a character and clothes to a different masked region while using ControlNet to manage the composition. Without Regional Prompter I have no control over the areas the LoRAs are applied to, and they don't mix well.
It'd be very convenient if Region Specification by Prompt worked in conjunction with external masks. It's the functionality I need, but for a start the auto-generated mask of the Prompt doesn't work very well so using it is out for me.
I've tried multiple RP settings, these are the best so far:
RP Mask submode: Mask, RP Prompt submode: Prompt, RP Calc Mode: Latent
Use Base: False, RP Use Common: True, RP Use Ncommon: True
RP LoRA Neg Te Ratios: "1,1", RP LoRA Neg U Ratios: "1,1" (makes no difference)
Prompt:
portrait of Maisie Williams wearing a BREAK
in the (style:1.2) of <lora:artstyle:0.75> BREAK
long (lgtamr:1.2) <lora:clothes:0.85>
I'm using a well-known face to make it obvious when the style or issues kick in. The LoRAs still mix, just with a lower intensity and in different ways than when not using RP.
Mask and ControlNet canny for reference:
If I understood the docs correctly 0,50,50 region (brick red) is base when enabled, region 1 when it's off. That's line 2 here, since common prompt is enabled. 180,50,50 (blue-green) should be region 2/line 3 here.
After uploading the mask to the "Upload mask here cus gradio" box, I'm selecting Region 0 in the Inpaint+ Mask section and clicking twice on "Draw Region" to generate the masks.
Results:
So, is it possible to do what I'm trying? If yes, what am I doing wrong?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I've got an art style LoRA and a concept LoRA with clothes. I'm trying to combine them, applying the style to a character and clothes to a different masked region while using ControlNet to manage the composition. Without Regional Prompter I have no control over the areas the LoRAs are applied to, and they don't mix well.
It'd be very convenient if Region Specification by Prompt worked in conjunction with external masks. It's the functionality I need, but for a start the auto-generated mask of the Prompt doesn't work very well so using it is out for me.
I've tried multiple RP settings, these are the best so far:
Prompt:
I'm using a well-known face to make it obvious when the style or issues kick in. The LoRAs still mix, just with a lower intensity and in different ways than when not using RP.
Mask and ControlNet canny for reference:
If I understood the docs correctly 0,50,50 region (brick red) is base when enabled, region 1 when it's off. That's line 2 here, since common prompt is enabled. 180,50,50 (blue-green) should be region 2/line 3 here.
After uploading the mask to the "Upload mask here cus gradio" box, I'm selecting Region 0 in the Inpaint+ Mask section and clicking twice on "Draw Region" to generate the masks.
Results:
So, is it possible to do what I'm trying? If yes, what am I doing wrong?
(bonus early attempt because it's glorious)
Beta Was this translation helpful? Give feedback.
All reactions