Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Vision Adapter not loading when model loaded with lms #53

Open
Swicegood opened this issue Jul 28, 2024 · 0 comments
Open

Vision Adapter not loading when model loaded with lms #53

Swicegood opened this issue Jul 28, 2024 · 0 comments

Comments

@Swicegood
Copy link

Swicegood commented Jul 28, 2024

2024-07-28 15:02:45,079 - ERROR - LLM completion error: Error code: 400 - {'error': '<LM Studio error> Vision model is not loaded. Cannot process images. Suggestion: Make sure to load both the primary and the Vision Adapter models. See more info in https://huggingface.co/collections/lmstudio-ai/vision-models-gguf-6577e1ce821f439498ced0c1. Error Data: n/a, Additional Data: n/a'}

The model is responding just fine to request for image descriptions when run form the GUI.

my model folder llava-1.6-mistral-7b-gguf has two files in it llava-v1.6-mistral-7b.Q8_0.gguf, and mmproj-model-f16.gguf

PS C:\Users\Administrator> lms load --gpu=1.0
I LM Studio is not running in server mode. Starting the server...
I Successfully started the server and verified it is running.

! Use the arrow keys to navigate, type to filter, and press enter to select.

? Select a model to load | Type to filter...
>  cjpais/llava-1.6-mistral-7b-gguf/llava-v1.6-mistral-7b.Q8_0.gguf (7.70 GB)

Only one model is listed--same as in he GUI

@Swicegood Swicegood changed the title Vision Adpater not loading when model loaded with lms Vision Adapter not loading when model loaded with lms Jul 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant