Skip to content

How to specify/change max_tokens while using the server #242

Closed Answered by advaitdeshmukh
advaitdeshmukh asked this question in Q&A
Discussion options

You must be logged in to vote

I managed to figure it out. You can set it in the request body like so:
{ "messages": [ { "role": "system", "content": "You are a helpful assistant." }, { "role": "user", "content": "What is black hole?" } ], "max_tokens":2000 }

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by advaitdeshmukh
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant