Replies: 2 comments
-
|
afaik DTensor is still a prototype release |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Marking as stale. No activity in 60 days. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Your question
Ask a clear and concise question about Megatron-LM.
https://pytorch.org/docs/stable/distributed.tensor.parallel.html
Why not use tensor parallel APIs of pytorch
Beta Was this translation helpful? Give feedback.
All reactions