AnythingLLM integration
A full-stack application that enables you to turn any document, resource, or piece of content into context that any LLM can use as references during chatting. This application allows you to pick and choose which LLM or Vector Database you want to use as well as supporting multi-user management and permissions.
AnythingLLM divides your documents into objects called workspaces. A Workspace functions a lot like a thread, but with the addition of containerization of your documents. Workspaces can share documents, but they do not talk to each other so you can keep your context for each workspace clean.
Starting
# Start the service
harbor up anythingllm
# Open the UI
harbor open anythingllmOut of the box, connectivity:
- Ollama - You'll still need to select specific models for LLM and embeddings
- llama.cpp - Embeddings are not pre-configured
- SearXNG for Web RAG - still needs to be enabled for a specific Agent