Skip to content

Commit

Permalink
docs(index.md): new release notes
Browse files Browse the repository at this point in the history
  • Loading branch information
krrishdholakia committed Dec 27, 2024
1 parent 855868f commit 37f9981
Show file tree
Hide file tree
Showing 2 changed files with 76 additions and 1 deletion.
4 changes: 3 additions & 1 deletion docs/my-website/docs/proxy/rate_limit_tiers.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,8 @@
# ✨ Budget / Rate Limit Tiers

Create tiers with different budgets and rate limits. Making it easy to manage different users and their usage.
Define tiers with rate limits. Assign them to keys.

Use this to control access and budgets across a lot of keys.

:::info

Expand Down
73 changes: 73 additions & 0 deletions docs/my-website/release_notes/v1.56.1/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,73 @@
import Image from '@theme/IdealImage';

# v1.56.1

`key management`, `budgets/rate limits`, `logging`, `guardrails`

:::info

Get a 7 day free trial for LiteLLM Enterprise [here](https://litellm.ai/#trial).

**no call needed**

:::

## ✨ Budget / Rate Limit Tiers

Define tiers with rate limits. Assign them to keys.

Use this to control access and budgets across a lot of keys.

**[Start here](https://docs.litellm.ai/docs/proxy/rate_limit_tiers)**

```bash
curl -L -X POST 'http://0.0.0.0:4000/budget/new' \
-H 'Authorization: Bearer sk-1234' \
-H 'Content-Type: application/json' \
-d '{
"budget_id": "high-usage-tier",
"model_max_budget": {
"gpt-4o": {"rpm_limit": 1000000}
}
}'
```


## OTEL Bug Fix

LiteLLM was double logging litellm_request span. This is now fixed.

[Relevant PR](https://github.com/BerriAI/litellm/pull/7435)

## Logging for Finetuning Endpoints

Logs for finetuning requests are now available on all logging providers (e.g. Datadog).

What's logged per request:

- file_id
- finetuning_job_id
- any key/team metadata


**Start Here:**
- [Setup Finetuning](https://docs.litellm.ai/docs/fine_tuning)
- [Setup Logging](https://docs.litellm.ai/docs/proxy/logging#datadog)

## Dynamic Params for Guardrails

You can now set custom parameters (like success threshold) for your guardrails in each request.

[See guardrails spec for more details](https://docs.litellm.ai/docs/proxy/guardrails/custom_guardrail#-pass-additional-parameters-to-guardrail)












0 comments on commit 37f9981

Please sign in to comment.