About SimpleQA
Definition and scoring
- Organisation
- OpenAI
- Category
- Research
- Version
- Not evaluated
- Direction
- higher is better
- Ranking use
- Weighted 3.5%
- Contamination risk
- Unknown
A short-answer factuality benchmark designed to measure correctness on fact-seeking questions. Every genuine source row stays tied to its exact model label, configuration, benchmark version and evaluation system. The summary chart shows one best compatible score per canonical product; Score 2.0 admits only explicitly mapped, frozen protocols and keeps incompatible configurations separate.
Open benchmark source ↗