Is CLIP used in the checkpoint finetune.pt?

[JackJin7]

Hi,
Thanks for the fantastic repo and models!

It seems in the sample.py script, the model is loading CLIP and applies a CLIP embedding here

glid-3-xl/guided_diffusion/unet.py

Line 842 in a0b5be4

emb = emb + self.clip_proj(clip_embed).to(emb)

However, in the training script image_train_latent.py, I don't see any logic regarding CLIP (but image_train_inpaint.py does have). Can anyone explain more details on how finetune.pt was finetuned?

Also, it seems not much difference on the results comparing whether setting CLIP embedding to work or not.

Thanks for answering!