Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Keep configurable number of messages per context key, regardless of expiration time #151

Open
jlyons210 opened this issue Mar 26, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@jlyons210
Copy link
Owner

Enhancement:
Currently, the bot discards conversation context after 15 minutes. Since chat conversations are sometimes very asynchronous, it would be nice to have a configurable number of messages per context key (conversation thread) that are maintained indefinitely.

Say we have a conversation and there are 18 messages. If the context timeout is 15 minutes and a minimum retained messages is 5, the 5 most recent messages would be retained until the conversation picked up again.

This will also be implemented in envoy-ai.

@jlyons210 jlyons210 added the enhancement New feature or request label Mar 26, 2024
@jlyons210 jlyons210 self-assigned this Mar 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant