Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Our OpenAI "is server up" check was retrying (default openai client behaviour), with sleeps between retries! Really slowed things down. Especially since local servers (LiteLLM, etc) are often down if app closed. Now with retry=0 it's speedy
- Loading branch information