Model
Gemini 3.7 Flash
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| ArcticAbstain | 7.3 | abstention_rate | N/A | Independent | medium | arxiv.org |
| CritPt | 14.3 | accuracy | N/A | Independent | low | epoch.ai |
| GPQA Diamond | 94.8 | accuracy | N/A | Independent | high | epoch.ai |
| MOF-VERIFY | 62.8 | macro-f1 | N/A | Independent | medium | arxiv.org |
| ScholarCatalyst | 0.4 | r@20 | tool-calling agent | Independent | medium | arxiv.org |
| SimpleQA Verified | 69.2 | accuracy | N/A | Independent | high | epoch.ai |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| DeepSWE | 65.5 | pass@1 | mini-swe-agent | Independent | medium | deepswe.datacurve.ai |
| MetaKernelBench | 59.5 | paired_lift | cute dsl | Independent | medium | arxiv.org |
| SciCode | 59.8 | score | N/A | Independent | medium | artificialanalysis.ai |
| SWE-CC | 80.2 | resolve_rate | mini-swe-agent | Independent | medium | arxiv.org |
| WorldSolver | 29.3 | score | N/A | Independent | medium | arxiv.org |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| cua-speedrun | 89.6 | success_rate | N/A | Independent | medium | arxiv.org |
| DUDA-Bench | 0.2 | workflow_score | react | Independent | medium | arxiv.org |
| EngiWorld | 25.3 | engiscore | N/A | Independent | medium | arxiv.org |
| HyperBrowseComp | 31.7 | accuracy | N/A | Independent | medium | arxiv.org |
| HyperBrowseComp | 17.7 | accuracy | owl | Independent | medium | arxiv.org |
| KlinikeBench | 10.8 | strict_pass@1 | N/A | Independent | medium | arxiv.org |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| DSV-Mem | 39.6 | accuracy | N/A | Independent | medium | arxiv.org |
| Ego-SpaCR | 41.4 | accuracy | native video | Independent | medium | arxiv.org |
| GDP.pdf | 23.8 | gdp.pdf_score | N/A | Independent | medium | surgehq.ai |
| HSS | 39.8 | pass@1 | N/A | Independent | medium | arxiv.org |
| NextAct | 0.9 | h_10 | N/A | Independent | medium | arxiv.org |
| PlotGround-1k | 65.7 | accuracy | N/A | Independent | medium | arxiv.org |
Safety & Alignment
Safety & AlignmentAbstract Reasoning
Abstract ReasoningReproduced by the community
Loading community runs…