Why is controlnet consuming memory/have influence on automatic behavior when the extension is disabled?

[dilectiogames]

I've noticed that I get CUDA out of memory like crazy then looking inside the command prompt output I get a bunch of errors related with controlnet. But while is installed i have disabled in the webui interface I didn't use it.

for example with the same settings using the SD upscale in imgtoimg will fail (CUDA out of memory) with controlnet installed but not enabled BUT it will work fine with controlnet not installed