LiBai v0.2.0 Release！

[strint]

v0.2.0 (07/07/2022)

New Features:

• Support evaluation enabled and set eval_iter
• Support customized sampler in config.py
• Support rdma for pipeline-model-parallel
• Support multi fused kernel
  • fused_scale_mask_softmax_dropout
  • fused_scale_tril_softmax_mask_scale
  • fused_self_attention in branch libai_bench
• User Experience Optimization
• Optimization for training throughput, see benchmark for more details

New Supported Models:

• Support 3D parallel Roberta model
• Support 2D parallel (data parallel + tensor model parallel) SimCSE model
• Support Data parallel MAE model
• Support Data parallel MOCOV3 model

Release Tag:
https://github.com/Oneflow-Inc/libai/releases/tag/v0.2.0

[strint]

An introduction of the features in LiBai (Chinese Version)

介绍 LiBai 特性的中文文章：https://mp.weixin.qq.com/s/u1up19FQ-FoNLpZvM9dgkw