Model
google/gemma-4-31B-it
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| CritPt | 1.4 | accuracy | N/A | Independent | low | epoch.ai |
| GPQA Diamond | 75.8 | accuracy | N/A | Independent | high | epoch.ai |
| SimpleQA Verified | 10.4 | accuracy | N/A | Independent | high | epoch.ai |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| AptMQL-Bench | 62.0 | soft-ex | N/A | Independent | medium | arxiv.org |
| SciCode | 43.4 | score | N/A | Independent | medium | artificialanalysis.ai |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| AgentHorizon | 46.8 | accuracy | opencode | Independent | medium | arxiv.org |
| ReFract | 0.4 | success_rate | function calling | Independent | medium | arxiv.org |
Multimodal
MultimodalInstruction Following
Instruction Following| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| CreativePreferences | 0.7 | auc | N/A | Independent | medium | arxiv.org |
Abstract Reasoning
Abstract ReasoningReproduced by the community
Loading community runs…