LuminaBench
OpenAI / Published benchmarks

o3

Benchmark results and API pricing.

Best recorded results

Benchmark scores

Best eligible score in each benchmark.

ARC-AGI-2936High · ExperimentalGPQA Diamond1,047High · ExperimentalMystery Game Puzzles1,026High · ExperimentalLumina Reasoning Index1,003High · 3/3 Observed · Experimental

API pricing

USD / 1M tokens

Verified pricing is unavailable for this model.

ARC-AGI-2

ARC-AGI-2

Version 2
Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.

3 configurations · Publisher-run · Experimental conversion

936Best score · High
Explore ARC-AGI-2
GPQA Diamond

GPQA Diamond

Version Diamond-198
Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.

3 configurations · Publisher-run · Experimental conversion

1,047Best score · High
Explore GPQA Diamond
Mystery Game Puzzles

Mystery Game Puzzles

Version Puzzles-100
Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.

2 configurations · Publisher-run · Experimental conversion

1,026Best score · High
Explore Mystery Game Puzzles

Lumina Reasoning Index

Version 3
By LuminaIndex designed by LuminaBench using attributed, publisher-run benchmarks. Lumina did not rerun those evaluations.

3 configurations · Derived from published benchmarks · Experimental · 3/3 Observed

1,003Measured score · High
Explore Lumina Reasoning Index