Model
Muse Spark 1.2
Meta AI
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| CritPt | 17.7 | accuracy | N/A | Independent | low | epoch.ai |
| SimpleQA Verified | 60.3 | accuracy | N/A | Independent | high | epoch.ai |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| DeepSWE | 54.9 | pass@1 | mini-swe-agent | Independent | medium | deepswe.datacurve.ai |
| SciCode | 56.4 | score | N/A | Independent | medium | artificialanalysis.ai |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| StoreBench | 0.4 | composite | N/A | Independent | medium | arxiv.org |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GDP.pdf | 16.0 | gdp.pdf_score | N/A | Independent | medium | surgehq.ai |
Safety & Alignment
Safety & Alignment| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| DistressBench | 0.9 | score | N/A | Independent | medium | arxiv.org |
Reproduced by the community
Loading community runs…