About Korean Massive Multitask Language Understanding
Definition and scoring
- Organisation
- KMMLU Authors
- Category
- Knowledge
- Version
- 2024
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Unknown
Evaluates Korean expert-level knowledge across 45 subjects. 20% of questions require Korean cultural context. Every genuine source row stays tied to its exact model label, configuration, benchmark version and evaluation system. The summary chart shows one best compatible score per canonical product; Score 2.0 admits only explicitly mapped, frozen protocols and keeps incompatible configurations separate.
Open benchmark source ↗