Agent Arena
Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.Observed agent orchestrator effects in real user workflows.
Agent Arena · Lumina Score
Aggregate IPS · Published 2026-10-28
Signed publisher IPS estimates and 95% bounds; observations and sessions retained. Missing metrics are omitted from their graph; quality scores remain available.
Results table
Source & conversion
Arena agent, overall only. Published 2026-10-28; underlying evaluation timestamps are not supplied.
Signed IPS causal estimates with publisher 95% intervals, observation and session counts. No cost, time, token or tool-call measurements are published.
How the Lumina conversion works
1,000 + 75 × ((original score − -0.0010993491128136034) / 0.08770085980286019). The result is rounded once. Scores may tie.
Frozen initial valid overall cohort; one arithmetic mean per exact evaluated release/system, equal weight across releases rather than effort rows. Unbounded rating/IPS scales use a broad finite numeric guard, not percentage bounds or sign clamping. Subsequent refreshes never refit this calibration. Conversion is not an estimate or combined index.
- Calibration
- agent-arena-z75-v1 · experimental
- Reference mean
- -0.0010993491128136034
- Population SD
- 0.08770085980286019
- Coverage
- Standalone benchmark.
Identity, exclusions & attribution
Exact publisher labels and release qualifiers are retained. Only explicit native effort tokens create reasoning variants; token budgets remain separate.
Agent orchestrator, routed, dated and harness-qualified systems are not automatically equated with naked base models.
0 ambiguous repeated records are retained in original.json but excluded from ranking.
All published reasoning settings, including Claude Max, are included by default. Display labels use Low and xHigh; source labels remain in the retained records.
Official dataset · Pinned source revision · CC BY 4.0 · Agent methodology · Current signals
Publisher terms. Scores and resource figures are attributed to the original publisher.