Model

gemini-1.5-flash-002

Google

deepmind.google

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
Balrog14.6average_progressN/AIndependentmediumbalrogai.com
GPQA Diamond47.3accuracyN/AIndependenthighepoch.ai
MMLU73.9exact_matchN/AIndependentmediumcrfm.stanford.edu
PIQA87.5scoreN/AIndependentmediumarxiv.org

Multimodal

Multimodal
BenchmarkScoreMetricHarnessSourceConfidenceLink
GeoBench76.0acw_country_%N/AIndependentmediumgeobench.org

Reproduced by the community

Loading community runs…