Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding suggestion of optimizers for benchmark models. #145

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

stephanmg
Copy link
Collaborator

No description provided.

@stephanmg stephanmg marked this pull request as draft November 6, 2023 09:33
@stephanmg
Copy link
Collaborator Author

stephanmg commented Nov 6, 2023

Data needs to be updated with final results.

@stephanmg stephanmg self-assigned this Nov 13, 2023
@dilpath
Copy link
Collaborator

dilpath commented Jul 4, 2024

Thanks, this will be great to have!

I think for maintainability, a TSV table with the "raw" data is preferable. I can add a script that converts it to the markdown table and embeds it into the README. That way contributors can simply edit the TSV table with easy-to-understand "raw data" that they probably have like optimizer, number of starts, number of successful starts, time per start / whatever else, and the script can then compute the overall efficiency if sufficient data is provided.

We would also need a few more details about the optimizer and their hyperparameters (e.g., what is nlopt_42?). Some TSV with columns optimizer_id and description would suffice, we can then think how to present it...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants