Model
DeepSeek V4.1 Flash
DeepSeek · open weights
Knowledge & Reasoning
Knowledge & ReasoningMath
Math| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| OpenProblemBench | 1.2 | mean_judged_solve_rate | N/A | Independent | medium | arxiv.org |
| SELF-POT | 0.8 | success_rate | N/A | Independent | medium | arxiv.org |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| SciCode | 51.9 | score | N/A | Independent | medium | artificialanalysis.ai |
| Video2World | 30.5 | v2wscore | N/A | Independent | medium | arxiv.org |
| WorldSolver | 24.6 | score | N/A | Independent | medium | arxiv.org |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| AgenticBBO-Bench | 0.6 | hpo | N/A | Independent | medium | arxiv.org |
| AgentMonBench | 0.8 | silentswap | N/A | Independent | medium | arxiv.org |
| Argo-Bench | 25.4 | score | N/A | Independent | medium | arxiv.org |
| BioStudyBench | 76.0 | pass_rate | N/A | Independent | medium | arxiv.org |
| BrickBench | 1006.0 | elo | N/A | Independent | medium | arxiv.org |
| CompMat-Bench | 66.0 | pass_rate | matclaw | Independent | medium | arxiv.org |
| EngiWorld | 25.5 | engiscore | N/A | Independent | medium | arxiv.org |
| HygieneRoboBench | 90.7 | resolved_rate | N/A | Independent | medium | arxiv.org |
| LIVIN | 11.4 | success_rate | N/A | Independent | medium | arxiv.org |
| Mine Odyssey | 23.9 | success_rate | N/A | Independent | medium | arxiv.org |
| RobotWorld | 1.2 | success_rate | N/A | Independent | medium | arxiv.org |
| ServeLearnBench | 33.2 | accuracy | skillopt | Independent | medium | arxiv.org |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GDP.pdf | 19.8 | gdp.pdf_score | N/A | Independent | medium | surgehq.ai |
| GeoSpatialBench | 49.5 | accuracy | N/A | Independent | medium | arxiv.org |
| PlotGround-1k | 29.3 | accuracy | N/A | Independent | medium | arxiv.org |
Instruction Following
Instruction Following| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Design Creativity Bench | 43.6 | overall | N/A | Independent | medium | arxiv.org |
Safety & Alignment
Safety & Alignment| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| FIGS | 37.3 | automated_judge_applying_a_10-rule_taxonomy_separating_sycophancy_from_calibrated_validation | N/A | Independent | medium | arxiv.org |
| ObligationBench | 32.1 | recall | N/A | Independent | medium | arxiv.org |
Abstract Reasoning
Abstract ReasoningReproduced by the community
Loading community runs…