Creative Story Writing — Lech Mazur
Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.Comparison rating
Creative Story Writing — Lech Mazur
No comparable per-task resource measurements were published. Missing metrics are omitted from their graph; quality scores remain available.
Results table
Method & coverage
60 writer models; 999 direct model pairings, 17,022 distinct story pairs and 113,566 judgements; evaluator models see matched stories in both orders. Relative comparison rating with 300 bootstrap resamples. Preserve partial-story and special configuration footnotes.
No comparable per-task resource measurements were published.
How the Lumina conversion works
1,000 + 75 × ((original score − -0.14669642857142864) / 2.1033776592631304). The result is rounded once. Scores may tie.
Frozen initial observed text-only cohort; one mean per exact publisher release/API, balancing repeated settings/routes within that release. Original score and protocol remain separate. No inferred variants or future refitting.
- Calibration
- writing-lechmazur-z75-v1 · experimental
- Reference mean
- -0.14669642857142864
- Population SD
- 2.1033776592631304
- Coverage
- Standalone benchmark.
Identity, exclusions & attribution
Original measurements and exact source settings retained; unknown API, effort and harness versions remain unknown.
Text story generation and text pairwise judging.
Standalone text benchmark; no new combined index. Source identity/effort/protocol qualifications remain in Data and CSV.
All published reasoning settings, including Claude Max, are included by default. Display labels use Low and xHigh; source labels remain in the retained records.
Publisher terms. Scores and resource figures are attributed to the original publisher.