Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add PromptSelector plugin to dynamically select the prompt & options to use based on context #3

Open
Stevenic opened this issue May 30, 2023 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@Stevenic
Copy link
Owner

Stevenic commented May 30, 2023

There are a cases where you might want to change the model (or even prompt) used for a given request based on the current context. Adding a new PromptSelector plugin will let a wave evaluate the current context and select the appropriate prompt and model to use. Here are a few scenarios this would enable:

  • Choosing an alternate model when giving feedback (see issue Add support for calling an alternate model when giving feedback #2.) Use a low cost model for the primary task but use GPT-4 to repair hallucinations.
  • Choosing an alternate model for longer prompts. Use a low cost model for short tasks but switch to GPT-4 when you need the added tokens.
  • Choosing an alternate model based on query complexity. You can use a classifier to select the model to use based off the complexity of the current query.

There would be 2 default implementations provided: The DefaultPromptSelector would just select the configured prompt every time. The FeedbackPromptSelector would chose an alternate prompt when giving the model feedback.

@Stevenic Stevenic added the enhancement New feature or request label May 30, 2023
@Stevenic Stevenic self-assigned this May 30, 2023
@rmolinamir
Copy link
Collaborator

Hi @Stevenic, this project is awesome. I've been using it at work for a little R&D, the appliance is in the media industry so I've been using it to generate automated translations of SRT files, it's been a great first step, the idea is to increase output and automate the operational workflow as much as possible. I've been thinking of using it for some side projects as well, I was wondering if you were open to contributors, I'd love to pitch in.

@Stevenic
Copy link
Owner Author

Stevenic commented Jun 21, 2023

Of course @rmolinamir... I'd love contributors... Let me setup discussions for the project and I'll invite you as a collaborator. I'm in the middle of adding support for OpenAI functions so quite a few moving pieces right now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants