Skip to content

Commit

Permalink
Update NeoXArgs docs automatically
Browse files Browse the repository at this point in the history
  • Loading branch information
github-actions committed Oct 24, 2023
1 parent 66d0666 commit 68dceb0
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions configs/neox_arguments.md
Original file line number Diff line number Diff line change
Expand Up @@ -111,7 +111,7 @@ Logging Arguments

- **git_hash**: str

Default = a97bd1f
Default = 66d0666

current git hash of repository

Expand Down Expand Up @@ -605,7 +605,7 @@ Optimizer Arguments

Default = adam

Type of optimizer to use. Choose from ['adam', 'onebitadam', 'cpu_adam', 'cpu_torch_adam', 'sm3', 'madgrad_wd', 'sgd', 'lion']
Type of optimizer to use. Choose from ['adam', 'onebitadam', 'cpu_adam', 'cpu_torch_adam', 'sm3', 'madgrad_wd', 'sgd']
NOTE: sgd will use MuSGD from Mup. Mup must be enabled for this optimizer.


Expand Down

0 comments on commit 68dceb0

Please sign in to comment.