About Terminal-Bench 4.0
Definition and scoring
- Organisation
- Harbor / Terminal-Bench
- Category
- Agents
- Version
- 4.0.0
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Unknown
A breaking 66-task release of the continuously versioned terminal-agent benchmark with calibrated resources, a flat eight-hour agent timeout, eight task removals, and 19 task fixes. Every genuine source row stays tied to its exact model label, configuration, benchmark version and evaluation system. The summary chart shows one best compatible score per canonical product; Score 2.0 admits only explicitly mapped, frozen protocols and keeps incompatible configurations separate.
Open benchmark source ↗