Model
qwen3.5-27B
Alibaba · open weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| InsClaimBench | 74.2 | accuracy | N/A | Independent | medium | arxiv.org |
Math
Math| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GraphDecide | 99.8 | accuracy | N/A | Independent | medium | arxiv.org |
| Prim | 47.8 | generation | N/A | Independent | medium | arxiv.org |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Closed-loop evaluation benchmark for embedded coding agents | 60.0 | pass_rate | N/A | Independent | medium | arxiv.org |
| Mobility Data Engineering Benchmark | 74.7 | success_rate | N/A | Independent | medium | arxiv.org |
Agentic / Tool Use
Agentic / Tool UseMultimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| BrainTRACE | 37.3 | accuracy | N/A | Independent | medium | arxiv.org |
| DSV-Mem | 9.6 | accuracy | N/A | Independent | medium | arxiv.org |
| EgoGears | 45.1 | accuracy | N/A | Independent | medium | arxiv.org |
| RoadSceneVQA-G | 49.1 | f1 | N/A | Independent | medium | arxiv.org |
| SpaceCast-Bench | 39.3 | accuracy | N/A | Independent | medium | arxiv.org |
| SpaceConflict | 62.5 | accuracy | N/A | Independent | medium | arxiv.org |
Safety & Alignment
Safety & Alignment| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| OMIT | 0.2 | obr | N/A | Independent | medium | arxiv.org |
| Unified Misuse Monitoring Benchmark | 0.9 | auc | N/A | Independent | medium | arxiv.org |
Abstract Reasoning
Abstract Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| SyntaxBench | 94.0 | accuracy | N/A | Independent | medium | arxiv.org |
Reproduced by the community
Loading community runs…