About KMMLU-Hard
Definition and scoring
- Organisation
- Daekeun ML
- Category
- Knowledge
- Version
- 2025
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Unknown
A filtered hard subset of KMMLU containing ~5,000 questions that most models get wrong. Every genuine source row stays tied to its exact model label, configuration, benchmark version and evaluation system. The summary chart shows one best compatible score per canonical product; Score 2.0 admits only explicitly mapped, frozen protocols and keeps incompatible configurations separate.
Open benchmark source ↗