Model

Gemini Exp 1206

Google

deepmind.google

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
LiveBench64.1global_averageN/AIndependentmediumlivebench.ai

Coding

Coding
BenchmarkScoreMetricHarnessSourceConfidenceLink
Aider Polyglot38.2percent_correctN/AIndependentmediumaider.chat

Multimodal

Multimodal
BenchmarkScoreMetricHarnessSourceConfidenceLink
MM-Vet78.1gpt-4_scoreN/AIndependentmediumpaperswithcode.com

Reproduced by the community

Loading community runs…