v0.0.1 Colossal-AI Beta Release
kurisusnowdeng
released this
28 Oct 16:49
·
3780 commits
to main
since this release
Features
- Data Parallelism
- Pipeline Parallelism (experimental)
- 1D, 2D, 2.5D, 3D and sequence tensor parallelism
- Easy-to-use trainer and engine
- Extensibility for user-defined parallelism
- Mixed Precision Training
- Zero Redundancy Optimizer (ZeRO)