Skip to content

Version v0.4.5 Release Today!

Compare
Choose a tag to compare
@github-actions github-actions released this 21 Oct 02:21
19baab5

What's Changed

Release

Misc

  • [misc] fit torch api upgradation and remove legecy import (#6093) by Hongxin Liu

Fp8

  • [fp8] add fallback and make compile option configurable (#6092) by Hongxin Liu

Chore

  • [chore] refactor by botbw

Ckpt

  • [ckpt] add safetensors util by botbw

Pipeline

Ring attention

Coati

Shardformer

  • [shardformer] optimize seq parallelism (#6086) by Hongxin Liu
  • [shardformer] fix linear 1d row and support uneven splits for fused qkv linear (#6084) by Hongxin Liu

Full Changelog: v0.4.5...v0.4.4