LuminaBench
Science benchmark / Vals AI

BioMysteryBench

Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.

Accuracy

Version 1-updated-2026-11-05Verified 6 November 202630 published resultsOfficial source

BioMysteryBench

LuminaBench
Show
20 of 30 models · best variant per model
03006009001,2001,114Claude Sonnet 5.5Max1,100GPT-6.1 SolMax1,096Claude Opus 5Max1,096Claude Opus 5.5Max1,096GPT-6 AstraMax1,068Gemini 4 ArgonHigh1,061Kimi K3.1 ProMax1,054GPT-6 SolMax1,040Wonder FullMax1,033Kimi K3Max1,029Grok 4.6High1,019GPT-5.6 SolMax1,012Claude Haiku 5.5Max1,008Models0.991,001Grok 4.7xHigh1,001Hy4 Preview1,001MiMo V2.6 Flash987DeepSeek V4.1 FlashHigh983Step 5 Preview980Ember-1

Lumina Score vs Cost per Task

Published per-test USD and Duration/Test retain their native definitions. Tokens use published averages or original aggregate counts divided by token_tasks_measured; total = input + output, with cache and reasoning subsets retained separately rather than counted twice. No task values are inferred from token prices or compute budgets.

LuminaBench
15 of 29 families
Lower resource use and higher score (green); higher resource use and lower score (red). Guides split at the visible selection’s medians.$0.3$1$37008009001,0001,100Cost per task · USD (log scale)Lumina ScoreClaude Sonnet 5.5GPT-6.1 SolClaude Opus 5GPT-6 AstraModels

Lumina Score vs Tokens

Published per-test USD and Duration/Test retain their native definitions. Tokens use published averages or original aggregate counts divided by token_tasks_measured; total = input + output, with cache and reasoning subsets retained separately rather than counted twice. No task values are inferred from token prices or compute budgets.

LuminaBench
15 of 24 families
02M4M6M8M7008009001,0001,100Total tokens per taskLumina ScoreClaude Sonnet 5.5GPT-6 AstraGPT-6.1 SolClaude Opus 5.5Gemini 4 ArgonKimi K3.1 Pro

Lumina Score vs Time per Task

Published per-test USD and Duration/Test retain their native definitions. Tokens use published averages or original aggregate counts divided by token_tasks_measured; total = input + output, with cache and reasoning subsets retained separately rather than counted twice. No task values are inferred from token prices or compute budgets.

LuminaBench
15 of 30 families
Lower resource use and higher score (green); higher resource use and lower score (red). Guides split at the visible selection’s medians.102030407008009001,0001,100Time per task · minLumina ScoreClaude Sonnet 5.5GPT-6.1 SolGPT-6 AstraClaude Opus 5Claude Opus 5.5Gemini 4 Argon

Published per-test USD and Duration/Test retain their native definitions. Tokens use published averages or original aggregate counts divided by token_tasks_measured; total = input + output, with cache and reasoning subsets retained separately rather than counted twice. No task values are inferred from token prices or compute budgets. Missing metrics are omitted from their graph; quality scores remain available.

Results table

Method & coverage

Bioinformatics data investigations through Terminus 2 terminal tools in package/database-restricted scientific sandboxes. 200 turns and four-hour cap; mean of three run scores, judge GPT-5.6 Terra. No image observation tools in this protocol.

Published per-test USD and Duration/Test retain their native definitions. Tokens use published averages or original aggregate counts divided by token_tasks_measured; total = input + output, with cache and reasoning subsets retained separately rather than counted twice. No task values are inferred from token prices or compute budgets.

How the Lumina conversion works

1,000 + 75 × ((original score − 69.14806666666668) / 7.86434873732226). The result is rounded once. Scores may tie.

Frozen initial observed text-only cohort; one mean per exact publisher release/API, balancing repeated settings/routes within that release. Original score and protocol remain separate. No inferred variants or future refitting.

Calibration
vals-biomysterybench-z75-v1 · experimental
Reference mean
69.14806666666668
Population SD
7.86434873732226
Coverage
Standalone benchmark.
Identity, exclusions & attribution

Bioinformatics data investigations through Terminus 2 terminal tools in package/database-restricted scientific sandboxes. 200 turns and four-hour cap; mean of three run scores, judge GPT-5.6 Terra. No image observation tools in this protocol.

Publisher standard errors retained; no confidence level or interval inferred. Aggregate reporting scope is recorded in the current source-specific publication review.

Standalone text benchmark; no new combined index. Source identity/effort/protocol qualifications remain in Data and CSV.

All published reasoning settings, including Claude Max, are included by default. Display labels use Low and xHigh; source labels remain in the retained records.

Official source · Publication terms / evidence

Publisher terms. Scores and resource figures are attributed to the original publisher.