Skip to content

Commit

Permalink
Bump to v0.3
Browse files Browse the repository at this point in the history
  • Loading branch information
aoyulong committed Apr 11, 2024
1 parent e1df903 commit 5c75bb7
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,10 @@ FlagScale provides developers with the actual configurations, optimization schem

## News and Updates

* 2024.4.11 🔥 We release the new version (v0.3):
* Accomplish the heterogeneous hybrid training of the Aquila2-70B-Expr model on a cluster utilizing a combination of NVIDIA and Iluvatar chips.
* Provide the training of the Aquila2 series across a variety of AI chips from six distinct manufacturers.

* 2023.11.30 We release the new version (v0.2):
* Provide the actually used training scheme for [Aquila2-70B-Expr](./aquila/70B), including the parallel strategies, optimizations and hyper-parameter settings.
* Support heterogeneous training on chips of different generations with the same architecture or compatible architectures, including NVIDIA GPUs and Iluvatar CoreX chips.
Expand Down

0 comments on commit 5c75bb7

Please sign in to comment.