New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

我怎么才能在图灵架构的GPU上部署书生-灵笔2.5大模型？TITAN RTX #438

Open

Eileen2003 opened this issue Sep 7, 2024 · 0 comments

Assignees

Eileen2003 commented Sep 7, 2024

Flash-Attention2报错：FlashAttention only supports Ampere GPUs or newer
一开始选择放弃用这个算法但是在源代码中发现不可避免地要用这个算法应该如何解决呢？

mm-assistant bot assigned myownskyW7

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment