Model

DeepSeek V3 0324

DeepSeek · open weights

deepseek.com

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
CritPt0.0accuracyN/AIndependentlowepoch.ai
GPQA Diamond67.6accuracyN/AIndependenthighepoch.ai
LiveBench66.9global_averageN/AIndependentmediumlivebench.ai

Coding

Coding
BenchmarkScoreMetricHarnessSourceConfidenceLink
Aider Polyglot55.1percent_correctN/AIndependentmediumaider.chat
SciCode35.8scoreN/AIndependentmediumartificialanalysis.ai
Web-Bench17.1pass@1N/AIndependentmediumarxiv.org

Reproduced by the community

Loading community runs…