[New preprocessor] we added depth leres++

[lllyasviel]

hi everyone, a bit late but we added depth leres++ preprocessor

Test input:

Midas:

Leres:

Zoe:

Leres++:

You need at least 1.1.133 to use it.

[danieltudosiu]

Is there a paper on this leres(++) depth estimator that I can reference/read?

[TechInterMezzo]

Same question: Is there any document describing the architecture of leres++? I am not so good at deducing it from the source code.

[affromero]

Hey guys, maybe for other folks that come to this discussion trying to understand what "leres++" means. I did not find much information by googling it, so I drop some info here:

sd-webui-controlnet/scripts/global_state.py

Line 56 in 7fb40bf

"depth_leres++": functools.partial(leres, boost=True),

• Leres++ is Leres with boosting.
• What is boosting? I do not use sd-webui-controlnet, so I can't tell much about where to find it here, but the first time I came across with the boosting was in the stable-diffusion-webui-depthmap-script repo, and the boosting is referring to this BoostingMonocularDepth repo, which quoting from there: "We achieve our results by getting several estimations at different resolutions. We then merge these into a structurally consistent high-resolution depth map followed by a local boosting to enhance the results and generate our final result".

Disclaimer: I do not know whether sd-webui-controlnet uses the exact same implementation, but at least this can give an idea of what it does and where it comes from.