Training on custom dataset with custom mask for Inpainting

[Akshay-Ijantkar]

Hello @DmitryUlyanov @avolution @cclauss @albarji @hafiz703
Great work on the paper and even the results look amazing!

Can you please guide me with step by step process on how we need to prepare a dataset for a custom image dataset with a custom mask (if possible)?

How the masks will look like in the sense that whether it will be a colour image on which white patches (the part that will be inpainted from the model) is drawn or it will be a completely black image on which white patches (the part that will be inpainted from the model) is drawn? (in short how to prepare mask and then how to supply it for model training)

I referred to your steps but couldn't completely follow them.
Thank you in advance!

[assia855]

I'm searching also to understand on how can I make it work on my custom dataset. If you get it done. Could you please guide me also.

[CoenHordijk]

Hello @DmitryUlyanov @avolution @cclauss @albarji @hafiz703 Great work on the paper and even the results look amazing!

Can you please guide me with step by step process on how we need to prepare a dataset for a custom image dataset with a custom mask (if possible)?

How the masks will look like in the sense that whether it will be a colour image on which white patches (the part that will be inpainted from the model) is drawn or it will be a completely black image on which white patches (the part that will be inpainted from the model) is drawn? (in short how to prepare mask and then how to supply it for model training)

I referred to your steps but couldn't completely follow them. Thank you in advance!

Hi, I managed to create a custom mask using The Gimp. I used an existing mask (they reside in data/inpainting) and changed it to my needs. You might be adding the image you want to mask as an extra layer, so you can hide certain areas of interest. Make sure you save the mask in the same bitdepth as the original mask. Save it with a name to your wishes and alter the code so it uses your custom mask.

As you might see from the original maskes they are white on the known area's and black on the unknown/to be inpainted areas.

What I would like to have is a random noise mask which covers a custom percentage of the image, but I think I'll create that one in the code and not with The Gimp.