Mathematics / Benchmark profile
The 2024 edition of AIME, maintaining the same format of 15 challenging mathematics problems with integer answers from 000 to 999.
Observed results
1 ranked models · higher is better · labels show rank and score
| Model | Rank | Model ID | Provider | Score | Unit |
|---|---|---|---|---|---|
| o3-mini | #1 | o3-mini | OpenAI | 87.3 | percent |
One best compatible score per canonical product · higher is better
| Rank | Model | Weights | Evidence | Score |
|---|---|---|---|---|
| 01 | o3-miniOpenAI | Closed weights | Source carrier | 87.3% |
Each distinct published measurement is retained. Same-snapshot canonical and configuration projections appear once.
| Published model / configuration | Score | Evidence & protocol | Source & dates |
|---|---|---|---|
Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.o3-miniExact identitySource label without a registered configuration ID Canonical product: o3-mini | 87.3% | Source carriersource-checkedVersion & system2024 Source-native system | BenchLM public datasets — 2026-08-01Observed Checked |
Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.o3-miniExact identitySource label without a registered configuration ID Canonical product: o3-mini | 87.3% | Source carriersource-checkedVersion & system2024 Source-native system | BenchLM public datasets — 2026-07-27Observed Checked |
Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.o3-miniExact identitySource label without a registered configuration ID Canonical product: o3-mini | 87.3% | Source carriersource-checkedVersion & system2024 Source-native system | BenchLM public datasets — 21 July 2026Observed Checked |
From result to context
The 2024 edition of AIME, maintaining the same format of 15 challenging mathematics problems with integer answers from 000 to 999.
The summary shows one best compatible source result per canonical product. Versions, effort settings and execution systems remain attached to the underlying records.
Scores from different versions or harnesses may not be interchangeable. The published source rows preserve those distinctions and their original units. A source result is not automatically an input to a current index.
This catalogue entry preserves available source evidence. Current indices admit only their specifically reviewed tracks and configurations.
Contamination risk: Unknown. Lifecycle: Active.
