Feature Request: Temporary Prompts for Context-Independent Queries

[tempookian]

Hello,

I'd like to propose a feature: the ability to send temporary prompts that don't follow the current conversation context.

Feature Description:

• Functionality: Users can send a temporary prompt (e.g., using a command like /temp) for a query unrelated to the ongoing conversation.
• Behavior: This temporary prompt should use the default initial prompt settings and not include any previous chat history in the request.
• Exclusion from Future Calls: The temporary prompt and its response should not be included in future API calls of the ongoing conversation.

Use Case:
This feature is particularly useful in scenarios where a user, while engaged in a specific conversation (e.g., proofreading a LaTeX document), needs to ask an unrelated question (like a quick LaTeX syntax query). It saves tokens by not sending the entire conversation context for these one-off queries and ensures more accurate responses by avoiding context confusion.

Importance:

• Efficiency: Saves tokens by avoiding the need to send the entire conversation history for context-independent queries.
• Accuracy: Reduces the likelihood of receiving inaccurate or contextually irrelevant responses.

I believe this feature would significantly enhance the user experience, particularly for those using the API for multitasking or diverse queries within a single session.

Thank you for considering this feature request.