New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

About the ZINC evaluation #88

Open

levyofek opened this issue Aug 11, 2024 · 0 comments

levyofek commented Aug 11, 2024

Hey!

I've two questions about the results reported for ZINC.

For every seed, how was the best MAE for the test reported: is it on the epoch in which the best validation MAE occurs? Additionally, in the table there is a report of the best epoch number, but over 4 seeds - what does that mean?
How is the MAE calculated for validation and test? It seems like it is calculated as the average of the averages of each batch in the val/test loaders - rather than the average over all the data. Is that correct?

Thx!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment