larger-scale radio models

[yeezhu]

Are there any plans to train or release larger-scale models, such as those based on the ViT-G architecture?

[gheinrich]

Hello, thanks for asking! RADIO ViT-H/16 already outperforms bigger foundation models on most metrics we tested it on. Is there one downstream use case in particular you feel would benefit from a more expensive architecture?

[yeezhu]

I replaced EVA-CLIP-ViT-G with radio (ViT-H) in my VLM, the performance drops on general VQA tasks. So, I was wondering if there is a ViT-G version for radio.

[mranzinger]

Would you be able to provide a few more details on your setup? We haven't observed a reduction in metrics versus that model.