How to work with embedding?

[Kapysta38]

I don't understand how to connect embeddings to my model, how to use them correctly when interacting via API (extension openai). I want to use other embedding, and how to change them I found here. But unfortunately I have not found a detailed description of how they work. Could you please give me some links or help me to understand it?

[aallsbury]

+1 This!
I have been trying to figure this out for a while. Hoping there is something similar to the tabby API situation where you can use cuda or cpu to host the embedding model and it populates under the OpenAI api endoint for embedding.

[Kapysta38]

I was able to achieve some results, but I don't have time to share them right now. I'll get back to you later.

[aallsbury]

Great to hear! please let me know when you can!