LuminaBench
Reasoning benchmark / ARC Prize

ARC-AGI-3

Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.

Verified interactive reasoning results on ARC-AGI-3.

Version 3Verified 31 October 2026112 published resultsOfficial source

ARC-AGI-3 · Lumina Score

Semi-Private · Standard harness

LuminaBench
Show
20 of 69 configurations
03507001,0501,4001,239GPT-6 AstraMax1,224GPT-6 AstraxHigh1,204GPT-6 AstraHigh1,195GPT-6.1 SolMax1,182Gemini 4 ArgonLow1,166Gemini 4 ArgonMedium1,138GPT-6.1 SolxHigh1,132GPT-6 AstraMedium1,117GPT-6 AstraNone1,094Claude Opus 5High1,079GPT-6.1 SolHigh1,068Claude Sonnet 5.5xHigh1,038GPT-6 AstraLow1,007GPT-6.1 SolMedium1,006Gemini 3.8 FlashHigh995GPT-5.6 SolMax991GPT-5.6 SolxHigh987Gemini 3.8 FlashLow981GPT-6 SolMax978Gemini 3.8 FlashMedium

Lumina Score vs Evaluation Cost

Publisher-reported evaluation cost; not a per-task price. · Standard harness

LuminaBench
15 of 24 families
$300$1000$3000$10000$300009001,0001,1001,2001,300Evaluation cost · USD (publisher totals) (log scale)Lumina ScoreClaude Haiku 5.5MaxGPT-6 AstraMaxClaude Opus 4.6MaxGPT-5.6 TerraMaxDeepSeek V4.1 FlashMaxClaude Opus 4.8HighGrok 4.7xHighGrok 4.6xHighGPT-5.6 SolMaxGPT-6.1 SolMaxGemini 3.8 FlashHighGemini 4 ArgonMediumClaude Sonnet 5.5xHighClaude Opus 5High

Missing resource measurements remain unavailable. Missing metrics are omitted from their graph; quality scores remain available.

Results table

ARC-AGI-3 3. Original publisher values and provisional Lumina conversion.
Rank
1GPT-6 AstraMax1,23962.71%$26,097.5ARC-AGI-3 Standard
2GPT-6 AstraxHigh1,22459.34%$37,317.39ARC-AGI-3 Standard
3GPT-6 AstraHigh1,20454.82%$40,704.72ARC-AGI-3 Standard
4GPT-6.1 SolMax1,19552.73%$7,632.48ARC-AGI-3 Standard
5Gemini 4 ArgonLow1,18249.79%$5,820.53ARC-AGI-3 Standard
6Gemini 4 ArgonMedium1,16646.27%$6,179.25ARC-AGI-3 Standard
7GPT-6.1 SolxHigh1,13839.93%$9,104.43ARC-AGI-3 Standard
8GPT-6 AstraMedium1,13238.59%$48,090.35ARC-AGI-3 Standard
9GPT-6 AstraNone1,11735.18%$49,791.11ARC-AGI-3 Standard
10Claude Opus 5High1,09430.16%$20,657.37ARC-AGI-3 Standard
11GPT-6.1 SolHigh1,07926.72%$9,757.62ARC-AGI-3 Standard
12Claude Sonnet 5.5xHigh1,06824.31%$7,394.47ARC-AGI-3 Standard
13GPT-6 AstraLow1,03817.45%$38,166.47ARC-AGI-3 Standard
14GPT-6.1 SolMedium1,00710.57%$7,369.78ARC-AGI-3 Standard
15Gemini 3.8 FlashHigh1,00610.37%$4,398.28ARC-AGI-3 Standard
16GPT-5.6 SolMax9957.78%$25,064.11ARC-AGI-3 Standard
17GPT-5.6 SolxHigh9916.99%$19,216.38ARC-AGI-3 Standard
18Gemini 3.8 FlashLow9875.99%$2,669.06ARC-AGI-3 Standard
19GPT-6 SolMax9814.62%$5,554.49ARC-AGI-3 Standard
20Gemini 3.8 FlashMedium9783.99%$2,727.66ARC-AGI-3 Standard
20GPT-6.1 SolLow9783.92%$7,110.56ARC-AGI-3 Standard
22GPT-5.6 SolHigh9702.15%$15,176.07ARC-AGI-3 Standard
23Grok 4.6xHigh9692.11%$5,612ARC-AGI-3 Standard
24GPT-6 SolxHigh9681.8%$5,105.62ARC-AGI-3 Standard
24Grok 4.7High9681.73%$3,741.65ARC-AGI-3 Standard
24Grok 4.7Medium9681.71%$3,795.49ARC-AGI-3 Standard
24Grok 4.7xHigh9681.82%$2,731.58ARC-AGI-3 Standard
28Claude Opus 4.8High9671.52%$10,000ARC-AGI-3 Standard
29Claude Sonnet 5.5High9651.2%$5,487.23ARC-AGI-3 Standard
29GPT-5.6 SolMedium9651.07%$12,971.17ARC-AGI-3 Standard
31DeepSeek V4.1 FlashMax9640.85%$1,164.91ARC-AGI-3 Standard
31GPT-5.6 TerraMax9640.8%$7,918.31ARC-AGI-3 Standard
31GPT-6 SolHigh9640.9%$5,072.45ARC-AGI-3 Standard
34GPT-5.6 TerraxHigh9630.65%$6,804.04ARC-AGI-3 Standard
35Claude Haiku 5.5Max9620.45%$388.11ARC-AGI-3 Standard
35Claude Sonnet 5.5Low9620.4%$4,756.68ARC-AGI-3 Standard
35Claude Sonnet 5.5Medium9620.4%$4,839.68ARC-AGI-3 Standard
35Claude Opus 4.6Max9620.51%$8,866.2ARC-AGI-3 Standard
35DeepSeek V4.1 FlashHigh9620.48%$1,005.8ARC-AGI-3 Standard
35DeepSeek V4.1 FlashLow9620.35%$820.63ARC-AGI-3 Standard
35DeepSeek V4.1 FlashNone9620.34%$734.73ARC-AGI-3 Standard
35Gemini 3.1 Pro (Preview)Not specified9620.42%$2,213.53ARC-AGI-3 Standard
35GPT-5.5High9620.43%$10,000ARC-AGI-3 Standard
35GPT-5.6 SolLow9620.33%$12,805.6ARC-AGI-3 Standard
35GPT-5.6 TerraHigh9620.49%$5,881.39ARC-AGI-3 Standard
35GPT-6 SolMedium9620.42%$4,863.8ARC-AGI-3 Standard
47Claude Opus 4.7High9610.18%$10,000ARC-AGI-3 Standard
47Muse Spark OpenxHigh9610.14%$3,908.42ARC-AGI-3 Standard
47GPT-5.4High9610.21%$5,187.41ARC-AGI-3 Standard
47GPT-5.6 LunaHigh9610.1%$2,482.44ARC-AGI-3 Standard
47GPT-5.6 LunaLow9610.17%$2,307.49ARC-AGI-3 Standard
47GPT-5.6 LunaMax9610.18%$3,189.42ARC-AGI-3 Standard
47GPT-5.6 LunaMedium9610.17%$2,379.13ARC-AGI-3 Standard
47GPT-6 LunaHigh9610.18%$255.98ARC-AGI-3 Standard
47GPT-6 LunaMax9610.1%$262.24ARC-AGI-3 Standard
47GPT-6 LunaMedium9610.19%$241.28ARC-AGI-3 Standard
47GPT-6 LunaxHigh9610.16%$262.68ARC-AGI-3 Standard
47GPT-6 SolLow9610.13%$4,752ARC-AGI-3 Standard
47GPT-6 SolNone9610.28%$4,655.55ARC-AGI-3 Standard
47Grok 4.5High9610.3%$6,892.87ARC-AGI-3 Standard
47Grok 4.5Low9610.26%$8,718.48ARC-AGI-3 Standard
47Grok 4.5Medium9610.32%$8,458.3ARC-AGI-3 Standard
47Grok 4.7Low9610.25%$4,814.88ARC-AGI-3 Standard
64GPT-5.6 LunaxHigh9600.02%$2,801.59ARC-AGI-3 Standard
64GPT-5.6 TerraLow9600.01%$5,068.48ARC-AGI-3 Standard
64GPT-5.6 TerraMedium9600.08%$5,895.31ARC-AGI-3 Standard
64GPT-6 LunaLow9600.03%$228.83ARC-AGI-3 Standard
64GPT-6 LunaNone9600.03%$229.77ARC-AGI-3 Standard
64Grok 4.20 (Beta Reasoning)Not specified9600.09%$3,775ARC-AGI-3 Standard
1 · GPT-6 AstraMax1239
Performance
62.71%
Evaluation cost · USD
$26,097.5
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
2 · GPT-6 AstraxHigh1224
Performance
59.34%
Evaluation cost · USD
$37,317.39
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
3 · GPT-6 AstraHigh1204
Performance
54.82%
Evaluation cost · USD
$40,704.72
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
4 · GPT-6.1 SolMax1195
Performance
52.73%
Evaluation cost · USD
$7,632.48
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
5 · Gemini 4 ArgonLow1182
Performance
49.79%
Evaluation cost · USD
$5,820.53
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
6 · Gemini 4 ArgonMedium1166
Performance
46.27%
Evaluation cost · USD
$6,179.25
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
7 · GPT-6.1 SolxHigh1138
Performance
39.93%
Evaluation cost · USD
$9,104.43
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
8 · GPT-6 AstraMedium1132
Performance
38.59%
Evaluation cost · USD
$48,090.35
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
9 · GPT-6 AstraNone1117
Performance
35.18%
Evaluation cost · USD
$49,791.11
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
10 · Claude Opus 5High1094
Performance
30.16%
Evaluation cost · USD
$20,657.37
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
11 · GPT-6.1 SolHigh1079
Performance
26.72%
Evaluation cost · USD
$9,757.62
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
12 · Claude Sonnet 5.5xHigh1068
Performance
24.31%
Evaluation cost · USD
$7,394.47
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
13 · GPT-6 AstraLow1038
Performance
17.45%
Evaluation cost · USD
$38,166.47
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
14 · GPT-6.1 SolMedium1007
Performance
10.57%
Evaluation cost · USD
$7,369.78
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
15 · Gemini 3.8 FlashHigh1006
Performance
10.37%
Evaluation cost · USD
$4,398.28
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
16 · GPT-5.6 SolMax995
Performance
7.78%
Evaluation cost · USD
$25,064.11
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
17 · GPT-5.6 SolxHigh991
Performance
6.99%
Evaluation cost · USD
$19,216.38
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
18 · Gemini 3.8 FlashLow987
Performance
5.99%
Evaluation cost · USD
$2,669.06
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
19 · GPT-6 SolMax981
Performance
4.62%
Evaluation cost · USD
$5,554.49
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
20 · Gemini 3.8 FlashMedium978
Performance
3.99%
Evaluation cost · USD
$2,727.66
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
20 · GPT-6.1 SolLow978
Performance
3.92%
Evaluation cost · USD
$7,110.56
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
22 · GPT-5.6 SolHigh970
Performance
2.15%
Evaluation cost · USD
$15,176.07
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
23 · Grok 4.6xHigh969
Performance
2.11%
Evaluation cost · USD
$5,612
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
24 · GPT-6 SolxHigh968
Performance
1.8%
Evaluation cost · USD
$5,105.62
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
24 · Grok 4.7High968
Performance
1.73%
Evaluation cost · USD
$3,741.65
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
24 · Grok 4.7Medium968
Performance
1.71%
Evaluation cost · USD
$3,795.49
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
24 · Grok 4.7xHigh968
Performance
1.82%
Evaluation cost · USD
$2,731.58
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
28 · Claude Opus 4.8High967
Performance
1.52%
Evaluation cost · USD
$10,000
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
29 · Claude Sonnet 5.5High965
Performance
1.2%
Evaluation cost · USD
$5,487.23
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
29 · GPT-5.6 SolMedium965
Performance
1.07%
Evaluation cost · USD
$12,971.17
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
31 · DeepSeek V4.1 FlashMax964
Performance
0.85%
Evaluation cost · USD
$1,164.91
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
31 · GPT-5.6 TerraMax964
Performance
0.8%
Evaluation cost · USD
$7,918.31
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
31 · GPT-6 SolHigh964
Performance
0.9%
Evaluation cost · USD
$5,072.45
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
34 · GPT-5.6 TerraxHigh963
Performance
0.65%
Evaluation cost · USD
$6,804.04
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
35 · Claude Haiku 5.5Max962
Performance
0.45%
Evaluation cost · USD
$388.11
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
35 · Claude Sonnet 5.5Low962
Performance
0.4%
Evaluation cost · USD
$4,756.68
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
35 · Claude Sonnet 5.5Medium962
Performance
0.4%
Evaluation cost · USD
$4,839.68
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
35 · Claude Opus 4.6Max962
Performance
0.51%
Evaluation cost · USD
$8,866.2
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
35 · DeepSeek V4.1 FlashHigh962
Performance
0.48%
Evaluation cost · USD
$1,005.8
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
35 · DeepSeek V4.1 FlashLow962
Performance
0.35%
Evaluation cost · USD
$820.63
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
35 · DeepSeek V4.1 FlashNone962
Performance
0.34%
Evaluation cost · USD
$734.73
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
35 · Gemini 3.1 Pro (Preview)Not specified962
Performance
0.42%
Evaluation cost · USD
$2,213.53
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
35 · GPT-5.5High962
Performance
0.43%
Evaluation cost · USD
$10,000
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
35 · GPT-5.6 SolLow962
Performance
0.33%
Evaluation cost · USD
$12,805.6
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
35 · GPT-5.6 TerraHigh962
Performance
0.49%
Evaluation cost · USD
$5,881.39
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
35 · GPT-6 SolMedium962
Performance
0.42%
Evaluation cost · USD
$4,863.8
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · Claude Opus 4.7High961
Performance
0.18%
Evaluation cost · USD
$10,000
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · Muse Spark OpenxHigh961
Performance
0.14%
Evaluation cost · USD
$3,908.42
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · GPT-5.4High961
Performance
0.21%
Evaluation cost · USD
$5,187.41
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · GPT-5.6 LunaHigh961
Performance
0.1%
Evaluation cost · USD
$2,482.44
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · GPT-5.6 LunaLow961
Performance
0.17%
Evaluation cost · USD
$2,307.49
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · GPT-5.6 LunaMax961
Performance
0.18%
Evaluation cost · USD
$3,189.42
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · GPT-5.6 LunaMedium961
Performance
0.17%
Evaluation cost · USD
$2,379.13
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · GPT-6 LunaHigh961
Performance
0.18%
Evaluation cost · USD
$255.98
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · GPT-6 LunaMax961
Performance
0.1%
Evaluation cost · USD
$262.24
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · GPT-6 LunaMedium961
Performance
0.19%
Evaluation cost · USD
$241.28
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · GPT-6 LunaxHigh961
Performance
0.16%
Evaluation cost · USD
$262.68
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · GPT-6 SolLow961
Performance
0.13%
Evaluation cost · USD
$4,752
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · GPT-6 SolNone961
Performance
0.28%
Evaluation cost · USD
$4,655.55
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · Grok 4.5High961
Performance
0.3%
Evaluation cost · USD
$6,892.87
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · Grok 4.5Low961
Performance
0.26%
Evaluation cost · USD
$8,718.48
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · Grok 4.5Medium961
Performance
0.32%
Evaluation cost · USD
$8,458.3
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
47 · Grok 4.7Low961
Performance
0.25%
Evaluation cost · USD
$4,814.88
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
64 · GPT-5.6 LunaxHigh960
Performance
0.02%
Evaluation cost · USD
$2,801.59
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
64 · GPT-5.6 TerraLow960
Performance
0.01%
Evaluation cost · USD
$5,068.48
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
64 · GPT-5.6 TerraMedium960
Performance
0.08%
Evaluation cost · USD
$5,895.31
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
64 · GPT-6 LunaLow960
Performance
0.03%
Evaluation cost · USD
$228.83
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
64 · GPT-6 LunaNone960
Performance
0.03%
Evaluation cost · USD
$229.77
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗
64 · Grok 4.20 (Beta Reasoning)Not specified960
Performance
0.09%
Evaluation cost · USD
$3,775
Agent / harness
ARC-AGI-3 Standard
Evidence
Model profile ↗

Source & conversion

Semi-Private evaluations. Standard is the primary harness; Provider Adapter results remain separate and never substitute for Standard.

The primary score measures human-normalized skill-acquisition performance, not accuracy. Costs are published evaluation totals, not per-task prices. Notes retain any partial-usage limitation.

How the Lumina conversion works

1,000 + 75 × ((original score − 8.97312670612202) / 16.8510495584195). The result is rounded once. Scores may tie.

Frozen initial verified cohort of 69 configurations; Standard harness only. Provider Adapter uses the same fixed scale but stays a separate view.

Calibration
arc-agi-3-z75-v1 · experimental
Reference mean
8.97312670612202
Population SD
16.8510495584195
Coverage
Standalone Reasoning benchmark.
Identity, exclusions & attribution

Verified publisher data, not an independent Lumina rerun.

Official leaderboard · Benchmark description

Publisher terms. Scores and resource figures are attributed to the original publisher.