About Arena-Hard-Auto
Definition and scoring
- Organisation
- LMSYS Org
- Category
- Instruction Following
- Version
- Not evaluated
- Direction
- higher is better
- Ranking use
- Not Weighted
- Contamination risk
- Unknown
An automated pairwise evaluation set derived from challenging user prompts. Every genuine source row stays tied to its exact model label, configuration, benchmark version and evaluation system. The summary chart shows one best compatible score per canonical product; Score 2.0 admits only explicitly mapped, frozen protocols and keeps incompatible configurations separate.
Open benchmark source ↗