Skip to content

v0.0.1 Colossal-AI Beta Release

Compare
Choose a tag to compare
@kurisusnowdeng kurisusnowdeng released this 28 Oct 16:49
· 3780 commits to main since this release
3245a69

Features

  • Data Parallelism
  • Pipeline Parallelism (experimental)
  • 1D, 2D, 2.5D, 3D and sequence tensor parallelism
  • Easy-to-use trainer and engine
  • Extensibility for user-defined parallelism
  • Mixed Precision Training
  • Zero Redundancy Optimizer (ZeRO)