Model
Muse Spark 1.3
Meta AI
Knowledge & Reasoning
Knowledge & ReasoningCoding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| E2E-SWE | 45.2 | pass@1 | N/A | Independent | medium | arxiv.org |
| SciCode | 59.7 | score | N/A | Independent | medium | artificialanalysis.ai |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Argo-Bench | 20.7 | score | N/A | Independent | medium | arxiv.org |
| BrickBench | 868.0 | elo | N/A | Independent | medium | arxiv.org |
| DAYJOB | 7.8 | success_rate | N/A | Independent | medium | arxiv.org |
| Incident-Arena | 0.3 | pass@1 | muse code | Independent | medium | arxiv.org |
| WorldAuditBench | 15.0 | success_rate | vlm auditors | Independent | medium | arxiv.org |
| WorldAuditBench | 6.6 | success_rate | vla–vlm auditors | Independent | medium | arxiv.org |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GDP.pdf | 27.6 | gdp.pdf_score | N/A | Independent | medium | surgehq.ai |
| HSS | 37.4 | pass@1 | N/A | Independent | medium | arxiv.org |
Instruction Following
Instruction Following| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Design Creativity Bench | 47.2 | overall | N/A | Independent | medium | arxiv.org |
Safety & Alignment
Safety & Alignment| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| DistressBench | 0.8 | score | N/A | Independent | medium | arxiv.org |
Reproduced by the community
Loading community runs…