Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Keywords ai #349

Merged
merged 3 commits into from
May 21, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
39 changes: 39 additions & 0 deletions website/docs/llms/Keywords-AI.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
---
description: Using LLMs from Keywords AI and have better observability.
---


# Keywords AI

:::info
[Keywords AI](https://keywordsai.co/) is a unified developer platform where you can call 150+ LLM using the OpenAI format with one API key and get insights into your AI products. With 2 lines of code, you can build better AI products with complete observability.
:::


1. Sign in [Keywords AI](https://keywordsai.co/) and generate an API key to call 150+ LLMs.

:::tip
The full list of supported models by Keywords AI can be found in the [page](https://platform.keywordsai.co/platform/models).
:::


2. Add the following content to your `taskweaver_config.json` file:

```json showLineNumbers
{
"llm.api_type":"openai",
"llm.api_base": "https://api.keywordsai.co/api/",
"llm.api_key": "Your_Keywords_AI_API_Key",
"llm.model": "gpt-4o",
}
```

:::info
If the configuration does not work, please refer to Keywords AI [documents](https://docs.keywordsai.co/get-started/quick-start) to locally test whether you can send requests to the LLM.
:::


3. Open a new terminal, start TaskWeaver and chat.
You can refer to the [Quick Start](../quickstart.md) for more details.

4. Suppose you want your AI products to be more robust and have better observability, such as having fallback models when primary models fail or knowing more about user activities. In that case, you can add parameters like fallback_models and customer_identifier in the extra_body param from OpenAI.
2 changes: 1 addition & 1 deletion website/sidebars.js
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ const sidebars = {
},
collapsible: true,
collapsed: true,
items: ['llms/openai', 'llms/aoai', 'llms/liteLLM', 'llms/ollama', 'llms/gemini', 'llms/qwen', 'llms/glm', 'llms/customized_llm_api', 'llms/multi-llm'],
items: ['llms/openai', 'llms/aoai', 'llms/liteLLM', 'llms/ollama', 'llms/gemini', 'llms/qwen', 'llms/glm','llms/Keywords-AI', 'llms/customized_llm_api', 'llms/multi-llm'],
},
{
type: 'category',
Expand Down