Model

Claude Opus 5

Anthropic · closed weights

anthropic.com

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
ArcticAbstain44.4abstention_rateN/AIndependentmediumarxiv.org
Balrog63.4average_progressN/AIndependentmediumbalrogai.com
CritPt29.1accuracyN/AIndependentlowepoch.ai
FREA68.0balanced_accuracyN/AIndependentmediumarxiv.org
GPQA Diamond93.9accuracyN/AIndependenthighepoch.ai
HouseholdBench0.9relmaeN/AIndependentmediumarxiv.org
MOF-VERIFY62.8macro-f1N/AIndependentmediumarxiv.org
SDDBench92.9accuracyN/AIndependentmediumarxiv.org
SimpleQA Verified59.9accuracyN/AIndependenthighepoch.ai
TasteVal2.1compute_multiplierN/AIndependentmediumarxiv.org

Coding

Coding
BenchmarkScoreMetricHarnessSourceConfidenceLink
A2Z GameSpec-Bench73.9gdd_fidelityN/AIndependentmediumarxiv.org
ArchitectureIQ76.0accuracyarchitectureiqIndependentmediumarxiv.org
ArrivalBench16.7failure_rateN/AIndependentmediumarxiv.org
CRBugBench48.3success_rateN/AIndependentmediumarxiv.org
DeepSWE73.6pass@1mini-swe-agentIndependentmediumdeepswe.datacurve.ai
E2E-SWE67.7pass@1N/AIndependentmediumarxiv.org
ModeBench0.1pcmdN/AIndependentmediumarxiv.org
ParanoiaEval58.7violation_rateN/AIndependentmediumarxiv.org
SciCode56.4scoreN/AIndependentmediumartificialanalysis.ai
TestSuiteBench55.5scoreN/AIndependentmediumarxiv.org
WorldSolver46.7scoreN/AIndependentmediumarxiv.org

Agentic / Tool Use

Agentic / Tool Use
BenchmarkScoreMetricHarnessSourceConfidenceLink
BOTTLED0.4f1N/AIndependentmediumarxiv.org
BrickBench1101.0eloN/AIndependentmediumarxiv.org
cua-speedrun91.6success_rateN/AIndependentmediumarxiv.org
DataSense-Bench35.9accuracyN/AIndependentmediumarxiv.org
DAYJOB8.4success_rateN/AIndependentmediumarxiv.org
DrugTargetWorld14.8scoreN/AIndependentmediumarxiv.org
EngiWorld44.3engiscoreN/AIndependentmediumarxiv.org
Incident-Arena0.4pass@1claude codeIndependentmediumarxiv.org
KlinikeBench29.4strict_pass@1N/AIndependentmediumarxiv.org
Learn2Play Bench73.0maxclaude codeIndependentmediumarxiv.org
Learn2Play Bench54.7maxevotestIndependentmediumarxiv.org
Learn2Play Bench50.3maxopencodeIndependentmediumarxiv.org
Learn2Play Bench46.2maxmemoryIndependentmediumarxiv.org
Mine Odyssey50.6success_rateN/AIndependentmediumarxiv.org
MMPostTrainBench44.4mean_task_score_(%)claude codeIndependentmediumarxiv.org
Open-Endedness Bench0.8e4_no_reward_hackingN/AIndependentmediumarxiv.org
TALK-Dem96.7success_rateN/AIndependentmediumarxiv.org
WorldAuditBench28.2success_ratevlm auditorsIndependentmediumarxiv.org
WorldAuditBench15.0success_ratevla–vlm auditorsIndependentmediumarxiv.org

Multimodal

Multimodal
BenchmarkScoreMetricHarnessSourceConfidenceLink
GDP.pdf24.0gdp.pdf_scoreN/AIndependentmediumsurgehq.ai
Knossos70.4f1N/AIndependentmediumarxiv.org
PlotGround-1k60.2accuracyN/AIndependentmediumarxiv.org
Video-Index56.8accuracyN/AIndependentmediumarxiv.org

Safety & Alignment

Safety & Alignment
BenchmarkScoreMetricHarnessSourceConfidenceLink
APEX-Harm6.5success_rateN/AIndependentmediumarxiv.org
DecepEval36.0deception_rateN/AIndependentmediumarxiv.org
DRYLAB-Bench0.1floor-included_brs_s2N/AIndependentmediumarxiv.org
EvoRiskBench43.4success_rateN/AIndependentmediumarxiv.org
Nonpublic Vulnerabilities Benchmark0.6attack_scoreclaude codeIndependentmediumarxiv.org

Abstract Reasoning

Abstract Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
ARC-AGI-290.4scoreN/AIndependentlowepoch.ai

Reproduced by the community

Loading community runs…