This repository has been archived by the owner on Sep 27, 2024. It is now read-only.

LM Studio GPU Offload Greyed Out #12

Open

Tobe2d opened this issue Jan 21, 2024 · 0 comments

Tobe2d commented Jan 21, 2024

I am running the latest LM Studio from the website and I realized that GPU Offload is Greyed Out.

nvidia-smi showing the following:

Sun Jan 21 17:21:12 2024
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 546.33 Driver Version: 546.33 CUDA Version: 12.3 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name TCC/WDDM | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+===========+|
| 0 NVIDIA GeForce RTX 4090 WDDM | 00000000:01:00.0 On | Off |
| 0% 42C P8 29W / 450W | 2613MiB / 24564MiB | 10% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+

Am I missing anything here?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.