Bitsandbytes error (cuda setup error) google colab

[fznx922]

having issues with bitsandbytes when comming upto loading pre trained checkpoint,

"CUDA SETUP: Something unexpected happened. Please compile from source:
git clone [email protected]:TimDettmers/bitsandbytes.git
cd bitsandbytes
CUDA_VERSION=122
python setup.py install
CUDA SETUP: Setup Failed!
CUDA SETUP: Something unexpected happened. Please compile from source:
git clone [email protected]:TimDettmers/bitsandbytes.git
cd bitsandbytes
CUDA_VERSION=122
python setup.py install
"

tried re installing certain versions on colab etc but still no joy

any help is appreciated

[kenilshah35]

Facing same issue on colab

[afsara-ben]

facing the same issue, any solution?

[rishabbahal9]

I fixed it, use the following versions:
!pip install -q transformers==4.33.2 bitsandbytes==0.41.1 accelerate==0.23.0
overall:

!pip install -q datasets librosa evaluate jiwer gradio
!pip install -q transformers==4.33.2 bitsandbytes==0.41.1 accelerate==0.23.0
!pip install -q git+https://github.com/huggingface/peft.git@main

You might have to restart the session after these installation before moving further.

[Baladon23]

I spent 2 days trying to get this Colab to work, it is impossible... Try this one: https://github.com/huggingface/peft/blob/main/examples/int8_training/peft_bnb_whisper_large_v2_training.ipynb