New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Batch API #460

Open

muelli opened this issue May 15, 2024 · 0 comments

muelli commented May 15, 2024

I wonder how much sense it would make to support the Batch API as it would further lower the cost:
https://platform.openai.com/docs/guides/batch/batch-api

I guess it would be a bit of an architectural change by polling for the answer every so often but maybe it's worth the effort.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment