Model
o3-mini
OpenAI · closed weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| CritPt | 0.3 | accuracy | N/A | Independent | low | epoch.ai |
| GPQA Diamond | 77.0 | accuracy | N/A | Independent | high | epoch.ai |
| LiveBench | 75.9 | global_average | N/A | Independent | medium | livebench.ai |
| SimpleQA Verified | 15.3 | accuracy | N/A | Independent | high | epoch.ai |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Aider Polyglot | 60.4 | percent_correct | N/A | Independent | medium | aider.chat |
| GSO | 1.3 | score_opt@1 | OpenHands | Independent | medium | epoch.ai |
| SciCode | 39.8 | score | N/A | Independent | medium | artificialanalysis.ai |
| Web-Bench | 9.1 | pass@1 | N/A | Independent | medium | arxiv.org |
Safety & Alignment
Safety & Alignment| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Cybench | 22.5 | unguided_%_solved | N/A | Independent | medium | cybench.github.io |
Abstract Reasoning
Abstract ReasoningReproduced by the community
Loading community runs…