LuminaBench
Anthropic / Published benchmarks

Claude 3.7

Benchmark results and API pricing.

Best recorded results

Benchmark scores

Best eligible score in each benchmark.

ARC-AGI-29238K · ExperimentalGPQA Diamond1,03564K · ExperimentalLumina Reasoning Index1,009Thinking 64K · 1/3 Provisional · Experimental

API pricing

USD / 1M tokens

Verified pricing is unavailable for this model.

ARC-AGI-2

ARC-AGI-2

Version 2
Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.

4 configurations · Publisher-run · Experimental conversion

923Best score · 8K
Explore ARC-AGI-2
GPQA Diamond

GPQA Diamond

Version Diamond-198
Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.

4 configurations · Publisher-run · Experimental conversion

1,035Best score · 64K
Explore GPQA Diamond

Lumina Reasoning Index

Version 3
By LuminaIndex designed by LuminaBench using attributed, publisher-run benchmarks. Lumina did not rerun those evaluations.

7 configurations · Derived from published benchmarks · Experimental · 1/3 Provisional

1,009Provisional score · Thinking 64K
Explore Lumina Reasoning Index