CUDA Setup failed despite GPU being available

[sandner-art]

After installation, A1111 will not start with these errors. Is it upgrading or downgrading anything cuda or bitsandbytes related? Maybe it interferes with some extension? Do you know a solution to this? I have tried reinstall bitsandbytes, also removing this traintrain extension but no luck. On fresh A1111 install it runs, but shows PermissionError: [Errno 13] Permission denied: when trying to save a setting... The original error:

Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues

binary_path: C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll
CUDA SETUP: Loading binary C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll...
Could not find module 'C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll' (or one of its dependencies). Try using the full path with constructor syntax.
CUDA SETUP: Loading binary C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll...
Could not find module 'C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll' (or one of its dependencies). Try using the full path with constructor syntax.
CUDA SETUP: Loading binary C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll...
Could not find module 'C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll' (or one of its dependencies). Try using the full path with constructor syntax.
CUDA SETUP: Problem: The main issue seems to be that the main CUDA library was not detected.
CUDA SETUP: Solution 1): Your paths are probably not up-to-date. You can update them via: sudo ldconfig.
CUDA SETUP: Solution 2): If you do not have sudo rights, you can do the following:
CUDA SETUP: Solution 2a): Find the cuda library via: find / -name libcuda.so 2>/dev/null
CUDA SETUP: Solution 2b): Once the library is found add it to the LD_LIBRARY_PATH: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:FOUND_PATH_FROM_2a
CUDA SETUP: Solution 2c): For a permanent solution add the export from 2b into your .bashrc file, located at ~/.bashrc
Traceback (most recent call last):
File "C:\SDXL\stable-diffusion-webui\launch.py", line 48, in
main()
File "C:\SDXL\stable-diffusion-webui\launch.py", line 44, in main
start()
File "C:\SDXL\stable-diffusion-webui\modules\launch_utils.py", line 465, in start
import webui
File "C:\SDXL\stable-diffusion-webui\webui.py", line 13, in
initialize.imports()
File "C:\SDXL\stable-diffusion-webui\modules\initialize.py", line 26, in imports
from modules import paths, timer, import_hook, errors # noqa: F401
File "C:\SDXL\stable-diffusion-webui\modules\paths.py", line 60, in
import sgm # noqa: F401
File "C:\SDXL\stable-diffusion-webui\repositories\generative-models\sgm_init_.py", line 1, in
from .models import AutoencodingEngine, DiffusionEngine
File "C:\SDXL\stable-diffusion-webui\repositories\generative-models\sgm\models_init_.py", line 1, in
from .autoencoder import AutoencodingEngine
File "C:\SDXL\stable-diffusion-webui\repositories\generative-models\sgm\models\autoencoder.py", line 12, in
from ..modules.diffusionmodules.model import Decoder, Encoder
File "C:\SDXL\stable-diffusion-webui\repositories\generative-models\sgm\modules_init_.py", line 1, in
from .encoders.modules import GeneralConditioner
File "C:\SDXL\stable-diffusion-webui\repositories\generative-models\sgm\modules\encoders\modules.py", line 5, in
import kornia
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\kornia_init_.py", line 11, in
from . import augmentation, color, contrib, core, enhance, feature, io, losses, metrics, morphology, tracking, utils, x
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\kornia\x_init_.py", line 2, in
from .trainer import Trainer
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\kornia\x\trainer.py", line 11, in
from accelerate import Accelerator
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\accelerate_init_.py", line 3, in
from .accelerator import Accelerator
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\accelerate\accelerator.py", line 35, in
from .checkpointing import load_accelerator_state, load_custom_state, save_accelerator_state, save_custom_state
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\accelerate\checkpointing.py", line 24, in
from .utils import (
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\accelerate\utils_init_.py", line 131, in
from .bnb import has_4bit_bnb_layers, load_and_quantize_model
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\accelerate\utils\bnb.py", line 42, in
import bitsandbytes as bnb
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes_init_.py", line 7, in
from .autograd.functions import (
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\autograd_init.py", line 1, in
from ._functions import undo_layout, get_inverse_transform_indices
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\autograd_functions.py", line 9, in
import bitsandbytes.functional as F
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\functional.py", line 17, in
from .cextension import COMPILED_WITH_CUDA, lib
File "C:\SDXL\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cextension.py", line 22, in
raise RuntimeError('''
RuntimeError:
CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment!
If you cannot find any issues and suspect a bug, please open an issue with detals about your environment:
https://github.com/TimDettmers/bitsandbytes/issues
Drücken Sie eine beliebige Taste . . .

[hako-mikan]

This error usually does not occur. Considering it's a permission error, I think the problem is likely due to it being installed on the C drive.

[za-wa-n-go]

In my case, this fixed it.

1. Enable Virtual Environment.
2. python -m pip uninstall bitsandbytes
3. python -m pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.1-py3-none-win_amd64.whl

bitsandbytes-foundation/bitsandbytes#1059 (comment)

(I use StabilityMatrix.)

[Derjyn]

It's not likely a permissions issue. I watched the install (which also failed for me), and it looks like a virtual environment wasn't referenced on (some?) steps. This resulted in some of my global libraries being screwed up, which is always just a pleasure to deal with.

The versions of various libraries referenced and such would by my guess. 99% of the other extensions and utilities I personally use are just fine, so when there is a particular one that doesn't play nice, I don't blame the other parts of the environment that follows standards and stable version adherence.

At any rate, the fix by @za-wa-n-go worked for me, so hopefully that's the only major issue!

[hako-mikan]

Thanks @za-wa-n-go