I downloaded gguf file manually, how can i add it to LM studio?

[dreambit]

I downloaded the gguf file manually; how can I add it to LM studio? I added it to folder, but i have You have 1 uncategorized model files

[JammersUK]

I think it's because you're not using the required directory structure.
If you have downloaded the model "DiscoLM_German_7b_v1-GGUF" by TheBloke via Huggingface, then the directory structure is: "TheBloke/DiscoLM_German_7b_v1-GGUF/", so the creator as the first directory in the models folder, then the models name as a folder, then the model is in that folder. I hope that makes sense.

[Iory1998]

You can just set a folder named "model" anywhere you want, manually download models and put them in that folder. I always download models using Internet Download Manager since I like to control the speed of the download.

Below is a screenshot of how I achieved that:

[danpe]

@JammersUK What is if its a model that didn't come from hugging face?

[thewriteway]

You can just set a folder named "model" anywhere you want, manually download models and put them in that folder. I always download models using Internet Download Manager since I like to control the speed of the download.

lory1198's solution worked for me.

I opened LM studio's storage location. Made a subdirectory called models, another below it called Llama. Moved all my GGUF files there with corresponding folder names.

Opened LM and did a model re-index. They were all then available for use.

Alternatively you can use the built in model import tool CLI wizard from LM studio. It can be found in your LM studio installation directory for example: AppData\Local\LM-Studio\app-0.3.2\resources\app.webpack
Just run "lms.exe" and point it to your GGUF