How to pass an Array of image base64

[Shinops]

Hello,

I’m trying to pass an array in an image in the app and I’m running into some trouble. Here’s what I’ve tried so far:

"controlnet": {
      "args": [
        {
       "image": ["base64image1","base64image2"] 
....
        },
}

and

  "controlnet": {
      "args": [
        {
          "image": [
            {
              "image": "base64image1",
              "mask": ""
            },
            {
              "image": "base64image2",
              "mask": ""
            }
          ],

But when I run it, I get this error:

*** Error running process: C:\AI\Forge\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
Traceback (most recent call last):
  File "C:\AI\Forge\webui\modules\scripts.py", line 803, in process
    script.process(p, *script_args)
  File "C:\AI\Forge\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "C:\AI\Forge\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 548, in process
    self.process_unit_after_click_generate(p, unit, params, *args, **kwargs)
  File "C:\AI\Forge\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "C:\AI\Forge\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 298, in process_unit_after_click_generate
    input_list, resize_mode = self.get_input_data(p, unit, preprocessor, h, w)
  File "C:\AI\Forge\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 206, in get_input_data
    elif (unit.image['image'] < 5).all() and (unit.image['mask'] > 5).any():
TypeError: list indices must be integers or slices, not str

Any chance that there is a proper way to pass an array of base64 or images, like when using the UI "Batch_Folder" or "Batch_input"?

I am using Forge if it matters.

Thank you!

[huchenlei]

Please file an issue in the forge repo. Forge's ControlNet API is not exactly aligned with sd-webui-controlnet's API.

[Shinops]

Thank you, I'll do that! Just for information, can sd-webui-controlnet do what I am trying to achieve?

[huchenlei]

The syntax you are using is for multi inputs unit. I am not sure if there is a good way to invoke batch processing via API.