Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Updated testset generation question prompts to use JSON formatting instructions + prompt tweaks for smaller LLMs #1354

Closed
wants to merge 4 commits into from
Closed

Updated testset generation question prompts to use JSON formatting instructions + prompt tweaks for smaller LLMs #1354

wants to merge 4 commits into from
+52 −27

Commits on Sep 7, 2024

  1. Improved JSON input rewrite prompt so it works with smaller LLMs

    @fschuh
    fschuh committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    16f221b View commit details
    Browse the repository at this point in the history

  2. Improved testset generation question rewriting prompts so they work w… 

    …ith smaller and chattier LLMs
    @fschuh
    fschuh committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    0053ec9 View commit details
    Browse the repository at this point in the history

  3. Updated testset generation keyphrase_extraction and find_relevant_chu… 

    …nk prompts to use JSON formatting instructions.

Also fixed incorrect index in one of the examples of find_relevant_contexts prompt (this will make it more explicit that the index is 1-based).
    @fschuh
    fschuh committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    d98467a View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Merge branch 'explodinggradients:main' into main

    @fschuh
    fschuh authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    aec598c View commit details
    Browse the repository at this point in the history