Model
o1-mini
OpenAI · closed weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GPQA Diamond | 62.4 | accuracy | N/A | Independent | high | epoch.ai |
| LiveBench | 57.8 | global_average | N/A | Independent | medium | livebench.ai |
Math
Math| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| FrontierMath | 1.0 | accuracy | N/A | Independent | medium | paperswithcode.com |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Aider Polyglot | 32.9 | percent_correct | N/A | Independent | medium | aider.chat |
| WebApp1k-Duo-React | 66.7 | pass@1 | N/A | Independent | medium | arxiv.org |
| WebApp1K-React | 93.9 | pass@1 | N/A | Independent | medium | arxiv.org |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| SocialNav-SUB | 0.6 | pa | N/A | Independent | medium | arxiv.org |
Safety & Alignment
Safety & Alignment| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Cybench | 10.0 | unguided_%_solved | N/A | Independent | medium | cybench.github.io |
Abstract Reasoning
Abstract ReasoningReproduced by the community
Loading community runs…