Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UI: replace chatbot with azure openai #251

Closed
shreyashankar opened this issue Dec 26, 2024 · 0 comments · Fixed by #256
Closed

UI: replace chatbot with azure openai #251

shreyashankar opened this issue Dec 26, 2024 · 0 comments · Fixed by #256

Comments

@shreyashankar
Copy link
Collaborator

shreyashankar commented Dec 26, 2024

Currently the frontend AI tools are using regular openai. We should switch to azure openai; with an option for users to use regular openai if they provide their own key.

This requires the following changes:

  • Allow /api/chat route to accept azure requests too (by default, actually)
  • Add a switch to the AI Chat panel component for azure or regular openai
  • Create new azure deployment dedicated for docetl (todo)
  • Set up azure keys in the frontend & some mechanism to cap the usage
  • Set up logging
  • Set up cron job that reads the total cost from the table and notifies us on slack if the usage has exceeded a threshold
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant