Model
Claude Fable 5
Anthropic · closed weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| CritPt | 28.6 | accuracy | N/A | Independent | low | epoch.ai |
| EnigmaEval | 39.3 | accuracy | N/A | Independent | medium | labs.scale.com |
| GPQA Diamond | 85.9 | accuracy | N/A | Independent | high | epoch.ai |
| SimpleQA Verified | 70.7 | accuracy | N/A | Independent | high | epoch.ai |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| ArchitectureIQ | 72.2 | accuracy | architectureiq | Independent | medium | arxiv.org |
| DeepSWE | 69.9 | pass@1 | mini-swe-agent | Independent | medium | deepswe.datacurve.ai |
| E2E-SWE | 65.3 | pass@1 | N/A | Independent | medium | arxiv.org |
| GSO | 78.4 | score_opt@1 | OpenHands | Independent | medium | gso-bench.github.io |
| MathVis | 26.6 | pass@1 | N/A | Independent | medium | arxiv.org |
| SciCode | 61.0 | score | N/A | Independent | medium | artificialanalysis.ai |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Open-Endedness Bench | 0.9 | e4_no_reward_hacking | N/A | Independent | medium | arxiv.org |
| OpenGameEval | 51.7 | pass_rate | N/A | Independent | medium | arxiv.org |
| StoreBench | 0.6 | composite | N/A | Independent | medium | arxiv.org |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GDP.pdf | 30.0 | gdp.pdf_score | N/A | Independent | medium | surgehq.ai |
| HSS | 34.5 | pass@1 | N/A | Independent | medium | arxiv.org |
Safety & Alignment
Safety & Alignment| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| DRYLAB-Bench | 0.0 | floor-included_brs_s2 | N/A | Independent | medium | arxiv.org |
Abstract Reasoning
Abstract ReasoningReproduced by the community
Loading community runs…