Skip to content

Commit

Permalink
Improve Clarity and Structure of Faithfulness Explanation in Document…
Browse files Browse the repository at this point in the history
…ation (#1114)

## Description
This PR enhances the documentation by improving the clarity and
structure of the faithfulness explanation. The changes include:

- Reorganizing the content for better flow and readability
- Clarifying the process of determining the faithfulness of generated
answers
- Fixing grammatical errors and improving sentence structure
  • Loading branch information
aybruhm authored Jul 22, 2024
1 parent 69b7c5d commit 4427eca
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/concepts/metrics/faithfulness.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

This measures the factual consistency of the generated answer against the given context. It is calculated from answer and retrieved context. The answer is scaled to (0,1) range. Higher the better.

The generated answer is regarded as faithful if all the claims that are made in the answer can be inferred from the given context. To calculate this a set of claims from the generated answer is first identified. Then each one of these claims are cross checked with given context to determine if it can be inferred from given context or not. The faithfulness score is given by divided by
The generated answer is regarded as faithful if all the claims made in the answer can be inferred from the given context. To calculate this, a set of claims from the generated answer is first identified. Then each of these claims is cross-checked with the given context to determine if it can be inferred from the context. The faithfulness score is given by:

```{math}
:label: faithfulness
Expand Down

0 comments on commit 4427eca

Please sign in to comment.