Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix async events for OpenAI API extension + Other small fixes #5952

Open
wants to merge 16 commits into
base: dev
Choose a base branch
from

Conversation

Artificiangel
Copy link

@Artificiangel Artificiangel commented Apr 28, 2024

Checklist:

Changes

  • OpenAI API extension now allows different tasks to run in parallel without locking up the webserver.

    • Run embedding functions while generating text (Originally only worked with streaming).
    • Send a request to StableDiffusion-WebUI while loading a text generation model.
    • Limit heavy tasks (split by category) to run in queue.
    • Tested all modified endpoints.
  • When throwing an error: Fixed model/load and lora/load endpoints returning errors with a 200 status code.
    Being unexpected, that might not be caught by users on client side.

  • For consistency added return "OK" to model/unload endpoint, matching lora/unload.

  • Removed awaiting of sync OAIimages.generations function in the images/generations endpoint that caused an error.

  • Use custom model/lora folder in downloader. (reverted to merge)

  • Fixed transcription endpoint.

  • Added Fastapi docs for: Transcriptions, image generation

@Artificiangel Artificiangel changed the title Fix async events for OpenAI API extension Fix async events for OpenAI API extension + Other small fixes Apr 29, 2024
@Artificiangel Artificiangel deleted the branch oobabooga:dev May 1, 2024 01:53
@Artificiangel Artificiangel deleted the dev branch May 1, 2024 01:53
@Artificiangel Artificiangel restored the dev branch May 1, 2024 02:18
@Artificiangel Artificiangel reopened this May 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant