How to convert Mistral model to gguf by using convert_hf_to_gguf.py? #9169

Unanswered

soichisumi asked this question in Q&A

soichisumi
Aug 25, 2024

I'm trying to convert Mistral model to gguf by using convert_hf_to_gguf.py.
but I got the following error.

Is Mistral model supported by llama.cpp?
If so, how can I fix this?

> poetry run python convert_hf_to_gguf.py ~/.cache/lm-studio/models/SFR-Embedding-2_R --outfile model.gguf --outtype q8_0 

INFO:hf-to-gguf:Loading model: SFR-Embedding-2_R
ERROR:hf-to-gguf:Model MistralModel is not supported

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment