Model
o4-mini
OpenAI · closed weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Contradiction Benchmark for Review Evaluation | 99.5 | accuracy | N/A | Independent | medium | arxiv.org |
| CritPt | 0.6 | accuracy | N/A | Independent | low | epoch.ai |
| EnigmaEval | 9.2 | accuracy | N/A | Independent | medium | labs.scale.com |
| GDPval | 25.3 | win_rate | N/A | Independent | low | epoch.ai |
| GPQA Diamond | 79.6 | accuracy | N/A | Independent | high | epoch.ai |
| HLE | 18.1 | accuracy | N/A | Independent | low | epoch.ai |
| SimpleQA Verified | 19.6 | accuracy | N/A | Independent | high | epoch.ai |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Aider Polyglot | 72.0 | percent_correct | N/A | Independent | medium | aider.chat |
| GSO | 3.6 | score_opt@1 | OpenHands | Independent | medium | gso-bench.github.io |
| Web-Bench | 13.3 | pass@1 | N/A | Independent | medium | arxiv.org |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GeoBench | 64.0 | acw_country_% | N/A | Independent | medium | geobench.org |
Abstract Reasoning
Abstract ReasoningReproduced by the community
Loading community runs…