New Features:
- Support mock transformers, see Mock transformers
- Support lm-evaluation-harness for model evaluation
- User Experience Optimization
New Supported Models:
- These models are natively supported by libai
| Models | 2D(tp+pp) Inference | 3D Parallel Training |
|---|---|---|
| BLOOM | ✔ | - |
| ChatGLM | ✔ | ✔ |
| Couplets | ✔ | ✔ |
| DALLE2 | ✔ | - |
| Llama2 | ✔ | ✔ |
| MAE | ✔ | ✔ |
| Stable_Diffusion | - | - |
New Mock Models:
- These models are extended and implemented by libai through mocking transformers.
| Models | Tensor Parallel | Pipeline Parallel |
|---|---|---|
| BLOOM | ✔ | - |
| GPT2 | ✔ | - |
| LLAMA | ✔ | - |
| LLAMA2 | ✔ | - |
| Baichuan | ✔ | - |
| OPT | ✔ | - |