Model
Qwen3.8 Flash
Alibaba · open weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| InsClaimBench | 76.6 | accuracy | N/A | Independent | medium | arxiv.org |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| MetaKernelBench | 35.1 | paired_lift | cute dsl | Independent | medium | arxiv.org |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| BOTTLED | 0.3 | f1 | N/A | Independent | medium | arxiv.org |
| BrickBench | 1048.0 | elo | N/A | Independent | medium | arxiv.org |
| EngiWorld | 16.1 | engiscore | N/A | Independent | medium | arxiv.org |
| WorldAuditBench | 12.7 | success_rate | vla–vlm auditors | Independent | medium | arxiv.org |
| WorldAuditBench | 8.5 | success_rate | vlm auditors | Independent | medium | arxiv.org |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| EMBER-Bench | 42.4 | accuracy | N/A | Independent | medium | arxiv.org |
| GDP.pdf | 16.6 | gdp.pdf_score | N/A | Independent | medium | surgehq.ai |
| HSS | 30.9 | pass@1 | N/A | Independent | medium | arxiv.org |
| MVGraph | 50.4 | accuracy | N/A | Independent | medium | arxiv.org |
| PlotGround-1k | 42.6 | accuracy | N/A | Independent | medium | arxiv.org |
Reproduced by the community
Loading community runs…