LuminaBench
← Lumina Journal

Haiku 5.5: our first benchmark results

We tried Low, Medium and High on all three tasks. Medium finished the suite for an estimated 4.6¢. High added detail, but took another 38 minutes.

Haiku 5.5 High’s pagoda: plenty of detail, although the original camera clips the top. This is the unmodified output.Credit: LuminaBenchExplore the Voxel archive ↗
Haiku 5.5 High’s voxel pagoda: a red and gold multi-tiered building surrounded by trees, paths and a densely planted garden. The original camera crops the finial.
Open original image ↗

Medium offered the best balance of performance, cost and generation time across our Haiku 5.5 tests: a voxel pagoda, a 3D seaplane and a kart racer.

It scored 987 overall for an estimated $0.04628 across the three generations. High got to 1,007, but took 59 minutes in total against Medium’s 21 minutes 10 seconds. At these prices, the waiting is a bigger consideration than the cost.

Haiku 5.5 Medium · the complete three-task suite
Capabilities Index
987Voxel 1,024 · 3D 952 · GameDev 986
Estimated cost
4.6¢$0.04628 across all three generations
Generation time
21m 10sSum of the three recorded durations

Haiku 5.5 arrived on 7 October, bringing adjustable effort to Anthropic’s smallest model. We tested all three settings in Claude Code. The results aren’t evenly good: the pagodas are impressive for the price, the seaplanes are weaker, and Low’s game doesn’t run.

The pagoda is the one to open first

Even Low gets the basic scene together: a multi-tiered pagoda, cherry trees, a gate and paths around a small island. Medium adds a fuller garden. High goes further with layered terrain and dense planting around the building.

Low · 1,008 Voxel Index · 3m 10sCredit: Original LuminaBench capture
Haiku Low’s voxel pagoda with red roofs, cherry trees, a gate and paths on a small island.
Open original image ↗
Medium · 1,024 Voxel Index · 3m 30sCredit: Original LuminaBench capture
The original front capture of Haiku Medium’s voxel pagoda and garden.
Open original image ↗

The framing is frustrating. Parts of the structure are cut off, and the dark façades make some of the detail hard to see. We’ve kept the original camera views here, including those problems. Still, getting this much into a scene for less than two cents is a good result.

Low falls down on the game

The Low submission loads a missing Three.js dependency, then throws before the race can start. It gets our fixed 800 task-failure score. We didn’t repair it and score the repaired version.

Medium and High both produce playable racers. Our checks reached a completed race and a working restart using the original game logic. High scores a little better, but they’re close: 986 for Medium, 997 for High.

Haiku High’s kart racer. Medium and High both reached playable output; Low failed to start.Credit: LuminaBenchOpen the GameDev archive ↗
Haiku High’s Mario Kart output on a rainbow-coloured track with racers, a lap counter and a minimap.
Open original image ↗

There are still bugs. High’s mute control stops the music but leaves engine and effects audio playing. Some item checks use inventory supplied by the test harness, so those passes don’t tell us that every pickup works naturally during a race. These are playable prototypes, with more testing and fixing needed.

What the extra time bought

Three efforts, three tasks · 10 October 2026
EffortVoxel3DGameDevOverall
Low1,008905800904
Medium1,024952986987
High1,0449809971,007
Source: Live Haiku results and evidence

Most of the overall improvement comes between Low and Medium, helped by getting a working game. High improves all three category scores again, but by smaller amounts.

Haiku’s three effort levels, highlighted against the rest of the suite. Scores and estimated total costs are from 10 October; the cost axis is logarithmic.Source: LuminaBenchExplore the interactive chart ↗
Lumina Capabilities Index against total estimated cost. The three Haiku 5.5 points are highlighted: Low 904 at $0.03395, Medium 987 at $0.04628 and High 1,007 at $0.081765. Other configurations provide context.
Open original image ↗

The seaplane scores go from 905 to 952 to 980. Low’s aircraft is almost black in its original rendering. Higher effort helps, although even High remains below the stronger 3D entries. You can compare the captures in the Seaplane archive.

High costs about 8.2¢ for the suite, against Medium’s 4.6¢. Its 20-point overall gain took an extra 37 minutes 50 seconds. High produced the most detailed pagoda and the highest scores, while Medium delivered working outputs on all three tasks in substantially less time.

Sources & references

  1. Claude Haiku 5.5: configurations and evidence ↗

    The registered Low, Medium and High outputs in Claude Code. Article figures use the 10 October 2026 data snapshot.

  2. Lumina Capabilities Index ↗

    Frozen article snapshot: capabilities-index-v4-309a588efc1a. Linked live charts may change as the dataset grows.

  3. Scoring and resource methodology ↗

    Three equally weighted categories, final rounding, failure scoring and estimated API-equivalent resource costs.

  4. Anthropic’s Haiku 5.5 announcement ↗

    7 October 2026. Context for the model’s release and adjustable effort settings.