Arena WebDev
Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.Published preferences for generated web applications.
Arena WebDev · Lumina Score
Overall preferences · Published 2026-10-28
Publisher preference ratings, bounds and vote counts retained. Missing metrics are omitted from their graph; quality scores remain available.
Results table
Source & conversion
Arena webdev, overall only. Published 2026-10-28; underlying evaluation timestamps are not supplied.
Preference ratings with exact publisher bounds, variance and vote counts. The dataset does not specify the interval level. No resource telemetry is published.
How the Lumina conversion works
1,000 + 75 × ((original score − 1463.8447770056782) / 151.92111567407474). The result is rounded once. Scores may tie.
Frozen initial valid overall cohort; one arithmetic mean per exact evaluated release/system, equal weight across releases rather than effort rows. Unbounded rating/IPS scales use a broad finite numeric guard, not percentage bounds or sign clamping. Subsequent refreshes never refit this calibration. Conversion is not an estimate or combined index.
- Calibration
- arena-webdev-z75-v1 · experimental
- Reference mean
- 1463.8447770056782
- Population SD
- 151.92111567407474
- Coverage
- Standalone benchmark.
Identity, exclusions & attribution
Exact publisher labels and release qualifiers are retained. Only explicit native effort tokens create reasoning variants; token budgets remain separate.
Agent orchestrator, routed, dated and harness-qualified systems are not automatically equated with naked base models.
2 ambiguous repeated records are retained in original.json but excluded from ranking.
All published reasoning settings, including Claude Max, are included by default. Display labels use Low and xHigh; source labels remain in the retained records.
Official dataset · Pinned source revision · CC BY 4.0
Publisher terms. Scores and resource figures are attributed to the original publisher.