Skip to content

Commit

Permalink
remove min olr
Browse files Browse the repository at this point in the history
  • Loading branch information
samsja committed Aug 22, 2024
1 parent 392a015 commit b2b3119
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion open_diloco/train_fsdp.py
Original file line number Diff line number Diff line change
Expand Up @@ -92,7 +92,6 @@ class HvConfig(BaseConfig):
galaxy_size: int
fail_rank_drop: bool = False # fail if we lose a diloco worker
warmup_outerstep: int = 10
outer_lr_min: float = 0.3
outer_scheduler: bool = False

@model_validator(mode="before")
Expand Down

0 comments on commit b2b3119

Please sign in to comment.