Model

Gemini 2.0 Flash Thinking Exp 01-21

Google

deepmind.google

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
EnigmaEval1.1accuracyN/AIndependentmediumlabs.scale.com
GPQA Diamond57.1accuracyN/AIndependenthighepoch.ai
HLE6.6accuracyN/AIndependentlowepoch.ai
LiveBench66.9global_averageN/AIndependentmediumlivebench.ai

Coding

Coding
BenchmarkScoreMetricHarnessSourceConfidenceLink
Aider Polyglot18.2percent_correctN/AIndependentmediumaider.chat

Reproduced by the community

Loading community runs…