Skip to content

Commit

Permalink
feat(docs): add o1 example
Browse files Browse the repository at this point in the history
  • Loading branch information
nsarrazin committed Dec 9, 2024
1 parent 287c512 commit 6f3ee74
Showing 1 changed file with 19 additions and 0 deletions.
19 changes: 19 additions & 0 deletions docs/source/configuration/models/providers/openai.md
Original file line number Diff line number Diff line change
Expand Up @@ -53,6 +53,25 @@ MODELS=`[{
}]`
```

We also support models in the `o1` family. You need to add a few more options ot the config: Here is an example for `o1-mini`:

```ini
MODELS=`[
{
"name": "o1-mini",
"description": "ChatGPT o1-mini",
"systemRoleSupported": false,
"parameters": {
"max_new_tokens": 2048,
},
"endpoints" : [{
"type": "openai",
"useCompletionTokens": true,
}]
}
]
```

You may also consume any model provider that provides compatible OpenAI API endpoint. For example, you may self-host [Portkey](https://github.com/Portkey-AI/gateway) gateway and experiment with Claude or GPTs offered by Azure OpenAI. Example for Claude from Anthropic:

```ini
Expand Down

0 comments on commit 6f3ee74

Please sign in to comment.