Model

Gemini Pro 1.5

Google

deepmind.google

Coding

Coding
BenchmarkScoreMetricHarnessSourceConfidenceLink
Web-Bench14.8pass@1N/AIndependentmediumarxiv.org

Long Context

Long Context
BenchmarkScoreMetricHarnessSourceConfidenceLink
MMNeedle39.91_image,_4*4_stitching,_exact_accuracyN/AIndependentmediumarxiv.org

Reproduced by the community

Loading community runs…