Model

Claude Sonnet 5

Anthropic · closed weights

anthropic.com

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
ArcticAbstain49.8abstention_rateN/AIndependentmediumarxiv.org
CritPt16.9accuracyN/AIndependentlowepoch.ai
GPQA Diamond90.5accuracyN/AIndependenthighepoch.ai
HouseholdBench0.9relmaeN/AIndependentmediumarxiv.org
MechHypoBench43.7mca_(%)claude codeIndependentmediumarxiv.org
MOF-VERIFY62.8macro-f1N/AIndependentmediumarxiv.org
SimpleQA Verified33.7accuracyN/AIndependenthighepoch.ai

Coding

Coding
BenchmarkScoreMetricHarnessSourceConfidenceLink
ArchitectureIQ44.0accuracyarchitectureiqIndependentmediumarxiv.org
ArrivalBench48.2failure_rateN/AIndependentmediumarxiv.org
DeepSWE53.8pass@1mini-swe-agentIndependentmediumdeepswe.datacurve.ai
E2E-SWE43.1pass@1N/AIndependentmediumarxiv.org
GSO37.3score_opt@1OpenHandsIndependentmediumgso-bench.github.io
ParanoiaEval22.2violation_rateN/AIndependentmediumarxiv.org
PLCWorld50.9success_rateN/AIndependentmediumarxiv.org
SciCode53.6scoreN/AIndependentmediumartificialanalysis.ai
TaoD2C-Bench59.9accuracyN/AIndependentmediumarxiv.org

Agentic / Tool Use

Agentic / Tool Use
BenchmarkScoreMetricHarnessSourceConfidenceLink
AgentMonBench0.8silentswapN/AIndependentmediumarxiv.org
Argo-Bench17.3scoreN/AIndependentmediumarxiv.org
BOTTLED0.2f1N/AIndependentmediumarxiv.org
DelegationBench68.7accuracyN/AIndependentmediumarxiv.org
DrugTargetWorld21.3scoreN/AIndependentmediumarxiv.org
DUDA-Bench0.1workflow_scorereactIndependentmediumarxiv.org
KlinikeBench13.8strict_pass@1N/AIndependentmediumarxiv.org

Multimodal

Multimodal
BenchmarkScoreMetricHarnessSourceConfidenceLink
ChartBmkAgent50.7accuracyN/AIndependentmediumarxiv.org
HeiCo-FOCUS35.3accuracyN/AIndependentmediumarxiv.org
InteractionBench44.6scoreN/AIndependentmediumarxiv.org
PlotGround-1k55.6accuracyN/AIndependentmediumarxiv.org
SpaceCast-Bench38.3accuracyN/AIndependentmediumarxiv.org

Safety & Alignment

Safety & Alignment
BenchmarkScoreMetricHarnessSourceConfidenceLink
APEX-Harm0.0success_rateN/AIndependentmediumarxiv.org
DecepEval36.2deception_rateN/AIndependentmediumarxiv.org
RobustReview0.6joint_stability-discrimination_profile_and_human_alignment_scoresN/AIndependentmediumarxiv.org

Abstract Reasoning

Abstract Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
Actionable Indeterminacy Benchmark87.3accuracyN/AIndependentmediumarxiv.org

Reproduced by the community

Loading community runs…