LuminaBench

GameDev Index

Mario Kart v1 · 5 configurations · Independent index

The Mario Kart test
astra codex max kart 001 · character selectionCharacter selection
astra codex max kart 001 · race startRace start
Mario KartGPT-6 Astra / Max / Codex
Mario Kart1 active test · Mario Kart v1

GameDev Index

Model configurations, compared on the same creation task.

5 configurations
GameDev Index ranking. Select a column heading to sort.
RankModel / configuration
1GPT-6 AstraMax · CodexIndex1,069Cost · USD$6.212Generation time33.8 minTotal tokens2.33MTool calls201
2GPT-6 AstraxHigh · CodexIndex1,063Cost · USD$3.00Generation time25.2 minTotal tokens933KTool calls72
3GPT-6 AstraHigh · CodexIndex1,045Cost · USD$2.117Generation time15.2 minTotal tokens582.5KTool calls44
4GPT-6 AstraMedium · CodexIndex1,034Cost · USD$1.54Generation time12.8 minTotal tokens437KTool calls43
5GPT-6 AstraLight · CodexIndex1,011Cost · USD$0.967Generation time7.9 minTotal tokens49.5KTool calls32

5 of 5 configurations · Weighted gameplay scores.

GameDev Index

Capability across tested model configurations. · Curated

LuminaBench
9801,0001,0201,0401,0601,0801,100GameDev Index

GameDev Index vs Cost

Capability and cost · Curated

LuminaBench
$2$4$69801,0001,0201,0401,0601,0801,100Cost · USDGameDev Index

GameDev Index vs Generation Time

Capability and generation time · Curated

LuminaBench
1020309801,0001,0201,0401,0601,0801,100Generation time · minGameDev Index

GameDev Index vs Tokens

Capability and total tokens · Curated

LuminaBench
100K300K1M3M9801,0001,0201,0401,0601,0801,100Total tokens (log scale)GameDev Index

GameDev Index vs Tool Calls

Capability and tool calls · Curated

LuminaBench
501001502009801,0001,0201,0401,0601,0801,100Tool callsGameDev Index