Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A list of commonly tweaked parameters and how to tweak them in the experiment CLI #282

Closed
Tracked by #280
laserkelvin opened this issue Aug 29, 2024 · 1 comment
Closed
Tracked by #280
Assignees
Labels
documentation Improvements or additions to documentation

Comments

@laserkelvin
Copy link
Collaborator

laserkelvin commented Aug 29, 2024

It would be very handy to have a subsection in the experiment CLI documentation that lists out things that are regularly tweaked, and which config file to modify. Some parameters that come to mind are:

  • Learning rate (sits in model/task definition)
  • Callbacks (trainer config)
  • DDP training
  • Data loader workers and batch size

It is redundant since some of the things are already covered in the full text, but would be nice to have a very short and snappy section that lets you know at a glance. Feel free to add to the list.

@lory-w if you have things to add as you discover them, you can omnibus them in if you beat @melo-gonzo 😸

@laserkelvin laserkelvin added the documentation Improvements or additions to documentation label Aug 29, 2024
@laserkelvin
Copy link
Collaborator Author

Closed by #295.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

2 participants