Model
gemini-1.5-flash-001
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| BoolQ | 85.8 | score | N/A | Independent | medium | arxiv.org |
| GPQA Diamond | 40.4 | accuracy | N/A | Independent | high | epoch.ai |
| MMLU | 77.9 | exact_match | N/A | Independent | medium | crfm.stanford.edu |
Math
MathMultimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Video-MME | 70.3 | overall_(no_subtitles) | N/A | Independent | medium | video-mme.github.io |
Reproduced by the community
Loading community runs…