Model
GPT-6.1 Sol
OpenAI · closed weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| CritPt | 31.7 | accuracy | N/A | Independent | low | epoch.ai |
| GPQA Diamond | 95.4 | accuracy | N/A | Independent | high | epoch.ai |
| SimpleQA Verified | 73.9 | accuracy | N/A | Independent | high | epoch.ai |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| SciCode | 55.8 | score | N/A | Independent | medium | artificialanalysis.ai |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Argo-Bench | 49.5 | score | N/A | Independent | medium | arxiv.org |
| BrickBench | 1293.0 | elo | N/A | Independent | medium | arxiv.org |
| RoboQuest | 12.2 | success_rate | N/A | Independent | medium | arxiv.org |
Multimodal
MultimodalInstruction Following
Instruction Following| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Design Creativity Bench | 63.7 | overall | N/A | Independent | medium | arxiv.org |
Abstract Reasoning
Abstract ReasoningReproduced by the community
Loading community runs…