Skip to content

Commit

Permalink
Update answer_relevance.md: Minor spell correct
Browse files Browse the repository at this point in the history
artifical -> artificial
  • Loading branch information
soumendrak authored Oct 1, 2024
1 parent 1c2384c commit 4075a30
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/concepts/metrics/answer_relevance.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

The evaluation metric, Answer Relevancy, focuses on assessing how pertinent the generated answer is to the given prompt. A lower score is assigned to answers that are incomplete or contain redundant information and higher scores indicate better relevancy. This metric is computed using the `user_input`, the `retrived_contexts` and the `response`.

The Answer Relevancy is defined as the mean cosine similarity of the original `user_input` to a number of artifical questions, which where generated (reverse engineered) based on the `response`:
The Answer Relevancy is defined as the mean cosine similarity of the original `user_input` to a number of artificial questions, which where generated (reverse engineered) based on the `response`:

$$
\text{answer relevancy} = \frac{1}{N} \sum_{i=1}^{N} cos(E_{g_i}, E_o)
Expand Down

0 comments on commit 4075a30

Please sign in to comment.