-
Notifications
You must be signed in to change notification settings - Fork 1
Permalink
Choose a base ref
{{ refName }}
default
Choose a head ref
{{ refName }}
default
Comparing changes
Choose two branches to see what’s changed or to start a new pull request.
If you need to, you can also or
learn more about diff comparisons.
Open a pull request
Create a new pull request by comparing changes across two branches. If you need to, you can also .
Learn more about diff comparisons here.
base repository: lucidrains/adam-atan2-pytorch
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: 0.1.4
Could not load branches
Nothing to show
Loading
Could not load tags
Nothing to show
{{ refName }}
default
Loading
...
head repository: lucidrains/adam-atan2-pytorch
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: main
Could not load branches
Nothing to show
Loading
Could not load tags
Nothing to show
{{ refName }}
default
Loading
- 10 commits
- 6 files changed
- 1 contributor
Commits on Nov 21, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f6ab117 - Browse repository at this point
Copy the full SHA f6ab117View commit details
Commits on Nov 22, 2024
-
diverges on language model training with default beta2 in adopt, brin…
…g it down to 0.99
Configuration menu - View commit details
-
Copy full SHA for 57ffaf3 - Browse repository at this point
Copy the full SHA 57ffaf3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0177579 - Browse repository at this point
Copy the full SHA 0177579View commit details -
Configuration menu - View commit details
-
Copy full SHA for 661aed2 - Browse repository at this point
Copy the full SHA 661aed2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4ba86bc - Browse repository at this point
Copy the full SHA 4ba86bcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7137f5d - Browse repository at this point
Copy the full SHA 7137f5dView commit details -
Configuration menu - View commit details
-
Copy full SHA for ef23c81 - Browse repository at this point
Copy the full SHA ef23c81View commit details -
Configuration menu - View commit details
-
Copy full SHA for e3a0aff - Browse repository at this point
Copy the full SHA e3a0affView commit details
Commits on Nov 27, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 5a48ed9 - Browse repository at this point
Copy the full SHA 5a48ed9View commit details -
add the proposed cautious optimizer from https://arxiv.org/abs/2411.1…
…6085, but allow for attenuating unaligned updates with some factor instead of zeroing completely
Configuration menu - View commit details
-
Copy full SHA for 8f14cf5 - Browse repository at this point
Copy the full SHA 8f14cf5View commit details
There are no files selected for viewing