New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BUG: Guidance engine generate wrong response, when have previous conversation #70

Open

Comoque1 opened this issue Dec 9, 2024 · 1 comment

Assignees

Labels

ai bug chatbot chatguidance genai guidance engine

Member

Comoque1 commented Dec 9, 2024

Describe the bug
A clear and concise description of what the bug is.

To Reproduce
Steps to reproduce the behavior:

Go to https://acc-alkem.io/
Authenticate with Alkemio user
Ask the following questions:
1. who are alkemio founders
2. who is Neil?
3. who is Rene?
4. who am I?
On the last question, I get answer, which haс information for me, which is not true

Expected behavior
TBD

Comoque1 added ai bug chatbot chatguidance genai guidance engine labels

valentinyanakiev assigned valeksiev

Member

valentinyanakiev commented Dec 10, 2024

There are 2 LLM calls:

first rephrases the question
second one uses the rephrased / summarized question and answers
based on the temperature, sometimes this leads to weird rephrasing and thus results

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment