LuminaBench
Healthcare benchmark / Vals AI

MedCode

Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.

Accuracy

Version 1-updated-2026-10-29Verified 6 November 2026107 published resultsOfficial source

MedCode

LuminaBench
Show
20 of 102 models · best variant per model
03006009001,2001,184Claude Opus 5Max1,146Gemini 3.1 Pro Preview (02/26)High1,144Gemini 4 ArgonHigh1,121Claude Fable 5Max1,120Gemini 3 Flash (12/25)High1,119Gemini 3.5 FlashHigh1,111Claude Opus 4.7Max1,099Claude Fable 5.1Max1,098Gemini 3.7 FlashHigh1,097Claude Opus 4.8Max1,096Gemini 3.6 FlashHigh1,094Claude Sonnet 5.5Max1,093GPT-5.1High1,088Gemini 3 Pro (11/25)High1,083Claude Haiku 5.5Max1,081Muse Spark1,075Gemini 2.5 Pro1,069Wonder FullMax1,068Claude Opus 5.5Max1,068GPT-5.2xHigh

Lumina Score vs Cost per Task

Published per-test USD and Duration/Test retain their native definitions. Tokens use published averages or original aggregate counts divided by token_tasks_measured; total = input + output, with cache and reasoning subsets retained separately rather than counted twice. No task values are inferred from token prices or compute budgets.

LuminaBench
15 of 100 families
Lower resource use and higher score (green); higher resource use and lower score (red). Guides split at the visible selection’s medians.$0.01$0.03$0.1$0.3$18009001,0001,1001,200Cost per task · USD (log scale)Lumina ScoreGemini 3 Flash (12/25)Claude Opus 5Gemini 3.1 Pro Preview (02/26)Gemini 4 ArgonClaude Fable 5Gemini 3.5 Flash

Lumina Score vs Tokens

Published per-test USD and Duration/Test retain their native definitions. Tokens use published averages or original aggregate counts divided by token_tasks_measured; total = input + output, with cache and reasoning subsets retained separately rather than counted twice. No task values are inferred from token prices or compute budgets.

LuminaBench
15 of 99 families
10K30K8009001,0001,1001,200Total tokens per task (log scale)Lumina ScoreClaude Opus 5Gemini 3.1 Pro Preview (02/26)Gemini 4 ArgonClaude Fable 5Gemini 3.5 Flash

Lumina Score vs Time per Task

Published per-test USD and Duration/Test retain their native definitions. Tokens use published averages or original aggregate counts divided by token_tasks_measured; total = input + output, with cache and reasoning subsets retained separately rather than counted twice. No task values are inferred from token prices or compute budgets.

LuminaBench
15 of 102 families
Lower resource use and higher score (green); higher resource use and lower score (red). Guides split at the visible selection’s medians.0.3138009001,0001,1001,200Time per task · min (log scale)Lumina ScoreGemini 3.7 FlashClaude Opus 5Gemini 3.1 Pro Preview (02/26)Claude Fable 5Gemini 3 Flash (12/25)

Published per-test USD and Duration/Test retain their native definitions. Tokens use published averages or original aggregate counts divided by token_tasks_measured; total = input + output, with cache and reasoning subsets retained separately rather than counted twice. No task values are inferred from token prices or compute budgets. Missing metrics are omitted from their graph; quality scores remain available.

Results table

Method & coverage

Text clinical records to ICD-10-CM codes; no clinical images.

Published per-test USD and Duration/Test retain their native definitions. Tokens use published averages or original aggregate counts divided by token_tasks_measured; total = input + output, with cache and reasoning subsets retained separately rather than counted twice. No task values are inferred from token prices or compute budgets.

How the Lumina conversion works

1,000 + 75 × ((original score − 41.71829906542056) / 8.905272206363957). The result is rounded once. Scores may tie.

Frozen initial observed text-only cohort; one mean per exact publisher release/API, balancing repeated settings/routes within that release. Original score and protocol remain separate. No inferred variants or future refitting.

Calibration
vals-medcode-z75-v1 · experimental
Reference mean
41.71829906542056
Population SD
8.905272206363957
Coverage
Standalone benchmark.
Identity, exclusions & attribution

Text clinical records to ICD-10-CM codes; no clinical images.

Publisher standard errors retained; no confidence level or interval inferred. Aggregate reporting scope is recorded in the current source-specific publication review.

Standalone text benchmark; no new combined index. Source identity/effort/protocol qualifications remain in Data and CSV.

All published reasoning settings, including Claude Max, are included by default. Display labels use Low and xHigh; source labels remain in the retained records.

Official source · Publication terms / evidence

Publisher terms. Scores and resource figures are attributed to the original publisher.