About SimpleQA Verified
Definition and scoring
- Organisation
- OpenAI / Google
- Category
- Research
- Version
- verified
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Medium
Factual short-answer evaluation derived from SimpleQA with stricter verification protocols against known ground-truth answers. Every genuine source row stays tied to its exact model label, configuration, benchmark version and evaluation system. The summary chart shows one best compatible score per canonical product; Score 2.0 admits only explicitly mapped, frozen protocols and keeps incompatible configurations separate.
Open benchmark source ↗