docs: v3.0.1 changelog

kozistr · Jun 22, 2024 · 3b56b70 · 3b56b70
1 parent e3398c7
commit 3b56b70
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/docs/changelogs/v3.0.1.md b/docs/changelogs/v3.0.1.md
@@ -8,6 +8,8 @@
   * support not-using-first-momentum when beta1 is not given
   * default dtype for first momentum to `bfloat16`
   * clip second momentum to 0.999
+* Implement `GrokFast` optimizer. (#244, #245)
+  * [Accelerated Grokking by Amplifying Slow Gradients](https://arxiv.org/abs/2405.20233)
 
 ### Bug