You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
instead of having a .conda folder in your home folder. have a symlink to the actual folder, stored in a different /scratch/ directory. i.e. by using `ln -s /scratch/.conda ~/.conda
Install scipy (from conda)
Install bitsandbytes from .conda file (for offline installation) here
Installation runs normally.
When running import bitsandbytes, the following warning is given:
Could not find the bitsandbytes CUDA binary at PosixPath('/hpc/<USER>/.conda/envs/<PROJECT>/lib/python3.11/site-packages/bitsandbytes/libbitsandbytes_cuda124.so')
The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
I have manually checked the path, following the symlink, and libbitsandbytes_cuda124.so does not exist but libbitsandbytes_cuda126.so exists.
Expected behavior
There should be some flexibility in the cuda version? I may have incorrectly installed the package
The text was updated successfully, but these errors were encountered:
ron0studios
changed the title
cannot find CUDA binary due to symlink
asking for CUDA 124 when only CUDA 126 exists
Jan 7, 2025
System Info
Nvidia V100 GPU
HPC server
conda installation
Reproduction
instead of having a .conda folder in your home folder. have a symlink to the actual folder, stored in a different
/scratch/
directory. i.e. by using `ln -s /scratch/.conda ~/.condaInstall scipy (from conda)
Install bitsandbytes from .conda file (for offline installation) here
Installation runs normally.
When running
import bitsandbytes
, the following warning is given:I have manually checked the path, following the symlink, and libbitsandbytes_cuda124.so does not exist but libbitsandbytes_cuda126.so exists.
Expected behavior
There should be some flexibility in the cuda version? I may have incorrectly installed the package
The text was updated successfully, but these errors were encountered: