About TruthfulQA
Definition and scoring
- Organisation
- Stephanie Lin, Jacob Hilton, Owain Evans
- Category
- Knowledge
- Version
- 2021
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Unknown
A benchmark designed to measure whether language models produce truthful answers instead of repeating common misconceptions or misleading falsehoods. Every genuine source row stays tied to its exact model label, configuration, benchmark version and evaluation system. The summary chart shows one best compatible score per canonical product; Score 2.0 admits only explicitly mapped, frozen protocols and keeps incompatible configurations separate.
Open benchmark source ↗