Skip to content

Commit

Permalink
Merge branch 'github-prs' into 'main'
Browse files Browse the repository at this point in the history
Github prs

See merge request ADLR/megatron-lm!734
  • Loading branch information
jaredcasper committed Aug 18, 2023
2 parents d97dffa + 1aa7144 commit 986019e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion megatron/arguments.py
Original file line number Diff line number Diff line change
Expand Up @@ -575,7 +575,7 @@ def _add_network_size_args(parser):
help='Use rotary positional embeddings or not. '
'Deprecated: use --position-embedding-type')
group.add_argument('--rotary-percent', type=float, default=1.0,
help='Percent of rotary dimension to use, default 100%')
help='Percent of rotary dimension to use, default 100%%')
group.add_argument('--rotary-seq-len-interpolation-factor', type=int, default=None,
help='Sequence length interpolation factor for rotary embeddings.')
group.add_argument('--no-position-embedding',
Expand Down

0 comments on commit 986019e

Please sign in to comment.