Model
Qwen Max (2025-01-25)
Alibaba · open weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GPQA Diamond | 56.1 | accuracy | N/A | Independent | high | epoch.ai |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Aider Polyglot | 21.8 | percent_correct | N/A | Independent | medium | aider.chat |
| Web-Bench | 15.9 | pass@1 | N/A | Independent | medium | arxiv.org |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| ChartDensity-Bench | 7.1 | mae | N/A | Independent | medium | arxiv.org |
| REBUS | 0.9 | accuracy | N/A | Independent | medium | arxiv.org |
| ScribbleEdit | 0.2 | intention_accuracy | N/A | Independent | medium | arxiv.org |
| VisAudit | 60.2 | recovery_rate | N/A | Independent | medium | arxiv.org |
Safety & Alignment
Safety & Alignment| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Sense and Sensitivity | 86.5 | accuracy | N/A | Independent | medium | arxiv.org |
Multilingual
MultilingualReproduced by the community
Loading community runs…