FrontierMath Open Problems
Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.Solve rate
FrontierMath Open Problems
No comparable per-task resource measurements were published. Missing metrics are omitted from their graph; quality scores remain available.
Results table
Method & coverage
68 Erdős open conjectures; text mathematical statements, Lean proof construction and isolated proof verification. Do not mix independently reported outside-Epoch proof announcements into the benchmark runs.
No comparable per-task resource measurements were published.
How the Lumina conversion works
1,000 + 75 × ((original score − 1.152436974789916) / 1.4856334059128964). The result is rounded once. Scores may tie.
Frozen initial observed text-only cohort; one mean per exact publisher release/API, balancing repeated settings/routes within that release. Original score and protocol remain separate. No inferred variants or future refitting.
- Calibration
- frontiermath-open-problems-z75-v1 · experimental
- Reference mean
- 1.152436974789916
- Population SD
- 1.4856334059128964
- Coverage
- Standalone benchmark.
Identity, exclusions & attribution
68 Erdős open conjectures; text mathematical statements, Lean proof construction and isolated proof verification. Do not mix independently reported outside-Epoch proof announcements into the benchmark runs.
Each run ID is retained. Repeated observations are not additional model releases or native reasoning settings. Standard errors are retained only where their mean-score association matches the selected primary metric.
Text mathematical statements/proof/code tools; no image, video, speech or screenshot input protocol.
Standalone text benchmark; no new combined index. Source identity/effort/protocol qualifications remain in Data and CSV.
All published reasoning settings, including Claude Max, are included by default. Display labels use Low and xHigh; source labels remain in the retained records.
Official source · Publication terms / evidence
Publisher terms. Scores and resource figures are attributed to the original publisher.