About Arena-Hard v2
Definition and scoring
- Organisation
- LMSYS
- Category
- Instruction Following
- Version
- v2
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Medium
Hard preference-style chat evaluation derived from Arena battle prompts, measuring instruction-following and helpfulness under automated judging. Every genuine source row stays tied to its exact model label, configuration, benchmark version and evaluation system. The summary chart shows one best compatible score per canonical product; Score 2.0 admits only explicitly mapped, frozen protocols and keeps incompatible configurations separate.
Open benchmark source ↗