Model
Muse Spark 1.1
Meta AI
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| CritPt | 15.1 | accuracy | N/A | Independent | low | epoch.ai |
| SimpleQA Verified | 57.8 | accuracy | N/A | Independent | high | epoch.ai |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| DeepSWE | 53.3 | pass@1 | mini-swe-agent | Independent | medium | deepswe.datacurve.ai |
| SciCode | 58.8 | score | N/A | Independent | medium | artificialanalysis.ai |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GDP.pdf | 15.0 | gdp.pdf_score | N/A | Independent | medium | surgehq.ai |
| RateAR | 0.6 | krcc | N/A | Independent | medium | arxiv.org |
Reproduced by the community
Loading community runs…