Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

asking for CUDA 124 when only CUDA 126 exists #1470

Open
ron0studios opened this issue Jan 7, 2025 · 0 comments
Open

asking for CUDA 124 when only CUDA 126 exists #1470

ron0studios opened this issue Jan 7, 2025 · 0 comments

Comments

@ron0studios
Copy link

ron0studios commented Jan 7, 2025

System Info

Nvidia V100 GPU
HPC server
conda installation

Reproduction

instead of having a .conda folder in your home folder. have a symlink to the actual folder, stored in a different /scratch/ directory. i.e. by using `ln -s /scratch/.conda ~/.conda

Install scipy (from conda)
Install bitsandbytes from .conda file (for offline installation) here

Installation runs normally.
When running import bitsandbytes, the following warning is given:

Could not find the bitsandbytes CUDA binary at PosixPath('/hpc/<USER>/.conda/envs/<PROJECT>/lib/python3.11/site-packages/bitsandbytes/libbitsandbytes_cuda124.so')
The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.

I have manually checked the path, following the symlink, and libbitsandbytes_cuda124.so does not exist but libbitsandbytes_cuda126.so exists.

Expected behavior

There should be some flexibility in the cuda version? I may have incorrectly installed the package

@ron0studios ron0studios changed the title cannot find CUDA binary due to symlink asking for CUDA 124 when only CUDA 126 exists Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant