[Feature] Cautious optimizer, improve the stability of ADOPT optimizer, a new projector type random for GaLore optimizer #294
Merged
kozistr merged 13 commits intomainfrom update/codesNov 27, 2024
+85-16
Commits
Commits on Nov 27, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
