Model
GPT-5.4 Pro
OpenAI · closed weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| CritPt | 30.0 | accuracy | N/A | Independent | low | epoch.ai |
| EnigmaEval | 23.8 | accuracy | N/A | Independent | medium | labs.scale.com |
| GPQA Diamond | 94.6 | accuracy | N/A | Independent | high | epoch.ai |
| HLE | 44.3 | accuracy | N/A | Independent | low | epoch.ai |
| LMArena | 1480.0 | elo | N/A | Self-reported | low | lmarena.ai |
| SimpleQA Verified | 46.3 | accuracy | N/A | Independent | high | epoch.ai |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| OSWorld | 75.0 | success_rate | N/A | Self-reported | low | os-world.github.io |
Abstract Reasoning
Abstract Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| ARC-AGI-2 | 83.3 | score | N/A | Independent | low | epoch.ai |
| ARC-AGI-2 | 83.3 | accuracy | N/A | Self-reported | low | arcprize.org |
Reproduced by the community
Loading community runs…