Skip to content

Commit

Permalink
Add claude caching disclaimer
Browse files Browse the repository at this point in the history
  • Loading branch information
Cohee1207 committed Nov 18, 2024
1 parent 76f34b3 commit fc05f8f
Showing 1 changed file with 9 additions and 1 deletion.
10 changes: 9 additions & 1 deletion Administration/config-yaml.md
Original file line number Diff line number Diff line change
Expand Up @@ -126,7 +126,7 @@ protocol:

| Setting | Description | Default | Permitted Values |
|---------|-------------|---------|-----------------|
| `mistral.enablePrefix` | Enable reply prefilling | `false` | `true`, `false` |
| `mistral.enablePrefix` | Enable reply prefilling. **The prefix will be echoed in the response** | `false` | `true`, `false` |

### Ollama Configuration

Expand All @@ -136,6 +136,14 @@ protocol:

### Claude Configuration

!!! warning
**IMPORTANT!**

Use with caution and only when the prompt prefix is static and doesn't change between requests. \{\{random\}\} macro, lorebooks, vectors, summaries, etc. will likely invalidate the cache and you'll just waste money on cache misses. Behavior may be unpredictable and no guarantees can or will be made.

See: [Prompt Caching](https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching)
!!!

| Setting | Description | Default | Permitted Values |
|---------|-------------|---------|-----------------|
| `claude.enableSystemPromptCache` | Enable system prompt caching | `false` | `true`, `false` |
Expand Down

0 comments on commit fc05f8f

Please sign in to comment.