You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I know. but I mean --pipeline-model-parallel-size=2 --num-layers-per-virtual-pipeline-stage=2 is accepted, while on the other hand being rejected as in a yaml and with a --yaml-cfg. It's inconsistent.
Describe the bug
This check isn't in sync with the one in the arguments.py
To Reproduce
pipeline_model_parallel_size = 2
, andnum_layers_per_virtual_pipeline_stage = 2
--yaml-cfg
Expected behavior
The setting
pipeline_model_parallel_size = 2
should be accepted.Proposed fix
sync up the check in the two places.
The text was updated successfully, but these errors were encountered: