Support writing optimizer checkpoint only on rank0 and make UT pass on A100#142
Merged
tocean merged 12 commits intomainfrom yuxiang/megatron_checkpointMar 1, 2024
+356-60
Commits
Commits on Feb 27, 2024
- committed
- committed
Commits on Feb 28, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed