Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixing gather_evidence and complete response messages #812

Merged
merged 5 commits into from
Jan 15, 2025

Conversation

jamesbraza
Copy link
Collaborator

@jamesbraza jamesbraza commented Jan 14, 2025

This PR fixes two misconceptions:

  • Fixing evidence counted in gather_evidence's response message #809 incorrectly based the relevant docs added count to l0, but it should have only been relevant ones
  • If complete tool gets passed has_successful_answer its response starts with "Success". However, if it turns out the answer is wrong, this response may not make sense. Now the response starts with "Sure" "Certain" to be clear

@jamesbraza jamesbraza added the bug Something isn't working label Jan 14, 2025
@jamesbraza jamesbraza requested review from sidnarayanan and a team January 14, 2025 23:33
@jamesbraza jamesbraza self-assigned this Jan 14, 2025
@dosubot dosubot bot added the size:M This PR changes 30-99 lines, ignoring generated files. label Jan 14, 2025
paperqa/agents/tools.py Outdated Show resolved Hide resolved
@whitead
Copy link
Collaborator

whitead commented Jan 15, 2025

can you deploy on dev? Would love to just double-check this

@jamesbraza jamesbraza force-pushed the fixing-tool-messages branch from 2750868 to 0375de9 Compare January 15, 2025 00:50
@jamesbraza
Copy link
Collaborator Author

can you deploy on dev? Would love to just double-check this

It works, and I added several expansions to the test_agent_sharing_state unit test to handle this

@jamesbraza jamesbraza requested review from whitead and a team January 15, 2025 00:51
@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Jan 15, 2025
@jamesbraza jamesbraza merged commit 7bb570c into main Jan 15, 2025
5 checks passed
@jamesbraza jamesbraza deleted the fixing-tool-messages branch January 15, 2025 01:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working lgtm This PR has been approved by a maintainer size:M This PR changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants