Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to Reproduce ANIL Results #422

Open
ImahnShekhzadeh opened this issue Nov 20, 2023 · 0 comments
Open

Unable to Reproduce ANIL Results #422

ImahnShekhzadeh opened this issue Nov 20, 2023 · 0 comments

Comments

@ImahnShekhzadeh
Copy link

Hi @seba-1511,

First of all thank you for this awesome repository! 🙂

I'm currently unable to reproduce the results of the script anil_fc100.py. I took the script and only adjusted the dataset path, but after 1k iterations, I get this output:

Iteration 999
Meta Train Error 0.5174707034602761
Meta Train Accuracy 0.8399999719113111
Meta Valid Error 1.5201084688305855
Meta Valid Accuracy 0.37499999022111297
Meta Test Error 1.2440147195011377
Meta Test Accuracy 0.4924999880604446

So clearly, I'm not obtaining the results that this tutorial describes, and there's huge overfitting.

Here are my package versions:

Python version: 3.10.3
learn2learn version: 0.2.0
PyTorch version: 2.1.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant