Model
gemini-1.5-pro-001
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| BBH | 89.2 | average | N/A | Self-reported | medium | storage.googleapis.com |
| GPQA Diamond | 45.9 | accuracy | N/A | Independent | high | epoch.ai |
| MMLU | 85.9 | exact_match | N/A | Self-reported | medium | storage.googleapis.com |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Video-MME | 75.0 | overall_(no_subtitles) | N/A | Independent | medium | video-mme.github.io |
Reproduced by the community
Loading community runs…