-
Notifications
You must be signed in to change notification settings - Fork 4.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BUG]: problem to run the example of colossalai #1929
Comments
Hi @lambda7xx Thank you for your feedback. We will try to reproduce your issue and fix it soon. |
I try https://github.com/hpcaitech/ColossalAI/tree/main/examples and there are lots of problem. BTW, I am working on a benchmark and try to implement gpt and swin transformer by using SP+PP of ColossalAI. I'm confused by the example code and document. So, could you help me implement gpt and swin transformer by using SP+PP of ColossalAI. You are more familiar with the ColossalAI than me. I have struggled with the implementation for half month. |
Actually, I am not an expert on SP and PP. I can help you to contact the author of the SP paper. @FrankLeeeee can you help with this project? |
thank you very much. |
We have updated a lot. This issue was closed due to inactivity. Thanks. |
🐛 Describe the bug
hpcaitech/ColossalAI-Examples#196
hpcaitech/ColossalAI-Examples#195
hpcaitech/ColossalAI-Examples#193
Environment
No response
The text was updated successfully, but these errors were encountered: