Model
gemini-1.5-pro-002
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Balrog | 21.0 | average_progress | N/A | Independent | medium | balrogai.com |
| GPQA Diamond | 57.2 | accuracy | N/A | Independent | high | epoch.ai |
| HLE | 4.6 | accuracy | N/A | Independent | low | epoch.ai |
| MMLU | 86.9 | exact_match | N/A | Independent | medium | crfm.stanford.edu |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| TheAgentCompany | 3.4 | resolved_rate | N/A | Independent | medium | github.com |
Abstract Reasoning
Abstract ReasoningReproduced by the community
Loading community runs…