Model
Qwen2.5-Coder-32B-Instruct
Alibaba · open weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| HellaSwag | 83.0 | overall_accuracy | N/A | Self-reported | medium | arxiv.org |
| LiveBench | 46.2 | global_average | N/A | Independent | medium | livebench.ai |
| MMLU | 79.1 | exact_match | N/A | Self-reported | medium | arxiv.org |
| WinoGrande | 80.8 | accuracy | N/A | Self-reported | medium | arxiv.org |
Math
MathCoding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Aider Polyglot | 16.4 | percent_correct | N/A | Independent | medium | aider.chat |
| SCCGBench | 2.9 | mock | N/A | Independent | medium | arxiv.org |
Long Context
Long ContextReproduced by the community
Loading community runs…