Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

🍄 Hallucinating rules #99

Open
2 tasks
bradystroud opened this issue Aug 2, 2023 · 0 comments
Open
2 tasks

🍄 Hallucinating rules #99

bradystroud opened this issue Aug 2, 2023 · 0 comments
Labels
Type: Feature A suggested idea for this project

Comments

@bradystroud
Copy link
Member

bradystroud commented Aug 2, 2023 •
edited
Loading

Hi @jackreimers

Pain

It is common that rules GPT will link to rules that dont exist

image

Figure: RulesGPT linked a rule that doesnt exisit

Suggested Solution

  • Refine the prompt
  • After generating a response, check if any of the links are 404s
    If they are, remove them and try get a better response

Tasks
Beta Give feedback

Acceptance Criteria

Instead of making up a rule, tell the user that there are no rules for that topic

Thanks!
@bradystroud bradystroud added the Type: Feature A suggested idea for this project label Aug 2, 2023
@bradystroud bradystroud mentioned this issue Aug 3, 2023
Closed
2 tasks
@bradystroud bradystroud changed the title ✨ Hallucinating rules 🍄 Hallucinating rules Sep 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Type: Feature A suggested idea for this project
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@bradystroud