Model
DeepSeek Chat
DeepSeek · open weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GPQA Diamond | 71.2 | accuracy | N/A | Independent | high | epoch.ai |
| MS-Exam-Gen | 86.9 | accuracy | N/A | Independent | medium | arxiv.org |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Aider Polyglot | 70.2 | percent_correct | N/A | Independent | medium | aider.chat |
| PolyCodeEval | 65.9 | pass_rate | repocoder | Independent | medium | arxiv.org |
| PolyCodeEval | 56.0 | pass_rate | hcp | Independent | medium | arxiv.org |
| PolyCodeEval | 50.7 | pass_rate | llm direct | Independent | medium | arxiv.org |
| PolyCodeEval | 36.7 | pass_rate | aligncoder | Independent | medium | arxiv.org |
Multimodal
MultimodalInstruction Following
Instruction FollowingSafety & Alignment
Safety & AlignmentMultilingual
MultilingualReproduced by the community
Loading community runs…