Chatbot powered by the Nous-Hermes-13B model.
- Refer to the quick start for general instructions on how to create server bots and deploy them on modal.com
- In Modal, create a secret named
nous-hermes-13b-secret
containing both yourTOGETHER_API_KEY
(obtainable by signing up at together.ai) and thePOE_ACCESS_KEY
you wish to use. - Run
modal serve main.py
- Create a bot on poe.com and provide your server url and access key.