Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

huggingface 下载的Qwen7B-chat/None #9

Open
molyswu opened this issue Jan 7, 2024 · 1 comment
Open

huggingface 下载的Qwen7B-chat/None #9

molyswu opened this issue Jan 7, 2024 · 1 comment

Comments

@molyswu
Copy link

molyswu commented Jan 7, 2024

line 317, in set_module_tensor_to_device
new_value = value.to(device)
File "D:\anaconda3\envs\minigpt4qwen\lib\site-packages\torch\cuda_init_.py", line 239, in _lazy_init
raise AssertionError("Torch not compiled with CUDA enabled")
AssertionError: Torch not compiled with CUDA enabled

pip installed torch-2.1.0+cu118 torchaudio-2.1.0+cu118 torchvision-0.16.0+cu118

@Coobiw
Copy link
Owner

Coobiw commented Jan 7, 2024

感谢关注!issue标题里的Qwen7B-chat/None/None是?然后对于您后续的问题,我感觉应该是cuda版本的问题 你可以试试

import torch
torch.cuda.is_available()

版本库依赖方面可以参考requirements

您这个问题建议参考:https://stackoverflow.com/questions/57814535/assertionerror-torch-not-compiled-with-cuda-enabled-in-spite-upgrading-to-cud

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants