Model
OpenAI/o1-2024-12-17-high
OpenAI · closed weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| EnigmaEval | 5.7 | accuracy | N/A | Independent | medium | labs.scale.com |
| GPQA Diamond | 76.8 | accuracy | N/A | Independent | high | epoch.ai |
| HLE | 8.0 | accuracy | N/A | Independent | low | epoch.ai |
| LiveBench | 75.7 | global_average | N/A | Independent | medium | livebench.ai |
| News QA | 81.4 | exact_match | N/A | Independent | medium | arxiv.org |
| SimpleQA Verified | 41.1 | accuracy | N/A | Independent | high | epoch.ai |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Aider Polyglot | 61.7 | percent_correct | N/A | Independent | medium | aider.chat |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GeoBench | 80.0 | acw_country_% | N/A | Independent | medium | geobench.org |
| SpatialViz-Bench | 41.4 | overall_score | N/A | Independent | medium | arxiv.org |
Reproduced by the community
Loading community runs…