Skip to content

Commit

Permalink
fixed: entrypoint.sh
Browse files Browse the repository at this point in the history
  • Loading branch information
glorenzo972 committed May 7, 2024
1 parent f8dc654 commit 54f25e9
Showing 1 changed file with 17 additions and 1 deletion.
18 changes: 17 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,11 @@ export PINECONE_API_KEY="pinecone api key"
export PINECONE_TEXT_KEY="pinecone field for text - default text in pod content"
export PINECONE_INDEX="pinecone index name"
export TILELLM_ROLE="role in pod. Train enable all the APIs, qa do not consume redis queue only Q&A"
export WORKERS=INT number of workers 2*CPU+1
export TIMEOUT=INT seconds of timeout default=180
export MAXREQUESTS=INT The maximum number of requests a worker will process before restarting. deafult=1200
export MAXRJITTER=INT The maximum jitter to add to the max_requests setting default=5
export GRACEFULTIMEOUT=INT Timeout for graceful workers restart default=30
tilellm
```

Expand All @@ -28,7 +33,18 @@ sudo docker build -t tilellm .


```
sudo docker run -d -p 8000:8000 --env environment="dev|prod" --env PINECONE_API_KEY="yourapikey" --env PINECONE_TEXT_KEY="text|content" --env PINECONE_INDEX="index_name" --env TILELLM_ROLE="train|qa" --env REDIS_URL="redis://redis:6379/0" --name tilellm --link test-redis:redis tilellm
sudo docker run -d -p 8000:8000 --env environment="dev|prod" \
--env PINECONE_API_KEY="yourapikey" \
--env PINECONE_TEXT_KEY="text|content" \
--env PINECONE_INDEX="index_name" \
--env TILELLM_ROLE="train|qa" \
--env WORKERS=3 \
--env TIMEOUT=180 \
--env MAXREQUESTS=1200 \
--env MAXRJITTER=5 \
--env GRACEFULTIMEOUT=30 \
--env REDIS_URL="redis://redis:6379/0" \
--name tilellm --link test-redis:redis tilellm
```
Expand Down

0 comments on commit 54f25e9

Please sign in to comment.