Skip to content

Commit

Permalink
Fix accelerate CLI HOWTO (#74)
Browse files Browse the repository at this point in the history
  • Loading branch information
loubbrad authored Dec 5, 2023
1 parent 3a396b6 commit 94680ec
Showing 1 changed file with 17 additions and 2 deletions.
19 changes: 17 additions & 2 deletions aria/train.py
Original file line number Diff line number Diff line change
Expand Up @@ -31,11 +31,26 @@
# For example usage you could run the pre-training script with:
#
# accelerate launch [arguments] aria/train.py pretrain \
# data/train.jsonl \
# data/val.jsonl \
# small \
# data/train \
# data/val \
# -epochs 10 \
# -bs 32 \
# -workers 8
#
# You could resume a run from an accelerate checkpoint with:
#
# accelerate launch [arguments] aria/train.py resume \
# small \
# pretrain \
# data/train \
# data/val \
# -cdir models/epoch5_step0 \
# -rstep 0 \
# -repoch 5 \
# -epochs 5 \
# -bs 32 \
# -workers 8

# TODO:
# - Test that everything works on a distributed setup
Expand Down

0 comments on commit 94680ec

Please sign in to comment.