Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Add model weights from Bamboo #1944

Open
NightMachinery opened this issue Sep 7, 2023 · 2 comments
Open

[FEATURE] Add model weights from Bamboo #1944

NightMachinery opened this issue Sep 7, 2023 · 2 comments
Labels
enhancement New feature or request

Comments

@NightMachinery
Copy link
Contributor

https://github.com/zhangyuanhan-ai/bamboo has released some interesting models, e.g., Bamboo-CLS ResNet-50 and Bamboo-CLS ViT B/16.

The ViT model beats most base ViTs I have seen in challenging datasets such as Objectnet.

@NightMachinery NightMachinery added the enhancement New feature or request label Sep 7, 2023
@rwightman
Copy link
Collaborator

@NightMachinery thanks, looks like it'd just be adding two sets of pretrained weights, resnet50 should be compatible already as it's torchvision compat, but the torchvision vit needs a slight remapping to timm... I'll take a closer look soon

@Laurent2916
Copy link
Contributor

Laurent2916 commented Nov 29, 2023

It looks like the ViT's state_dict simply has a "module." prefix on every key. Here is a simple notebook to convert the weights: https://colab.research.google.com/drive/1s9tohf-CncnYo_y7Wdga5Tvd3bylEHOX

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants