diff --git a/configs/neox_arguments.md b/configs/neox_arguments.md index bc2e8fc57..8d0c64cb9 100644 --- a/configs/neox_arguments.md +++ b/configs/neox_arguments.md @@ -111,7 +111,7 @@ Logging Arguments - **git_hash**: str - Default = 2da1083 + Default = 20d4228 current git hash of repository @@ -858,6 +858,38 @@ Parallelism Arguments Default = 1 + + + + +- **use_axonn_model_parallelism**: bool + + Default = False + + + + + +- **row_model_parallel_size**: int + + Default = 1 + + + + + +- **column_model_parallel_size**: int + + Default = 1 + + + + + +- **depth_model_parallel_size**: int + + Default = 1 + Size of the model parallelism.