About OpenBookQA
Definition and scoring
- Organisation
- Todor Mihaylov, Peter Clark, Tushar Khot, Ashish Sabharwal
- Category
- Knowledge
- Version
- 2018
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Unknown
A science question-answering benchmark that tests whether models can apply a small open-book set of elementary science facts to multi-step reasoning questions. Every genuine source row stays tied to its exact model label, configuration, benchmark version and evaluation system. The summary chart shows one best compatible score per canonical product; Score 2.0 admits only explicitly mapped, frozen protocols and keeps incompatible configurations separate.
Open benchmark source ↗