Custom Agent

A custom websearch agent useable with Ollama, SearXNG, and vLLM.

Agent schema:

Prerequisites

Environment setup

1. Install Anaconda:
   Download and install https://www.anaconda.com/.

2. Create and activate your virtual environment:

   conda create -n agent_env python pip
   conda activate agent_env

Clone the repository and install the requirements

git clone https://github.com/manjaroblack/custom_websearch_agent.git
cd custom_websearch_agent
pip install -r requirements.txt

Setup Ollama Server

1. Download and install Ollama: https://ollama.com/download

2. Create a custom Model:

   ollama create llama3_agentic -f ./MODELFILE

Setup and configure a SearXNG server

1. Setup a SearXNG Server: Repo: https://github.com/searxng/searxng

2. Configure SearXNG Copy the files in the SearXNG folder to your settings location

   1. /etc/searxng
   2. /usr/local/searxng

Run your query

python agent.py run

Then enter your query.