Model

MiniMax M2.5

MiniMax · open weights

minimax.io

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
CL-bench11.4overallN/AIndependentlowepoch.ai
CL-bench Life6.3overallN/AIndependentlowepoch.ai
GPQA Diamond85.2accuracyN/ASelf-reportedlowartificialanalysis.ai
LMArena1404.0eloN/ASelf-reportedlowlmarena.ai
MMLU-Pro76.5accuracyN/ASelf-reportedlowartificialanalysis.ai

Math

Math
BenchmarkScoreMetricHarnessSourceConfidenceLink
AIME 202586.3accuracyN/ASelf-reportedlowkaggle.com
EfficientOpt83.0solver_time_ratioN/AIndependentmediumarxiv.org
SELF-POT0.4success_rateN/AIndependentmediumarxiv.org

Coding

Coding
BenchmarkScoreMetricHarnessSourceConfidenceLink
LiveCodeBench65.0pass@1N/ASelf-reportedlowlivecodebench.github.io
SWE-bench Verified80.2resolved_rateN/ASelf-reportedlowswebench.com
Terminal-Bench 2.042.2accuracyN/ASelf-reportedlowtbench.ai

Agentic / Tool Use

Agentic / Tool Use
BenchmarkScoreMetricHarnessSourceConfidenceLink
DyadMem64.5accuracyN/AIndependentmediumarxiv.org
Terminal-Bench42.7accuracycchuterIndependentmediumtbench.ai
Terminal-Bench42.2accuracyTerminus 2Independentmediumtbench.ai
XiangqiBench0.8pass@3N/AIndependentmediumarxiv.org

Instruction Following

Instruction Following
BenchmarkScoreMetricHarnessSourceConfidenceLink
IFEval87.5prompt_strict_accuracyN/ASelf-reportedlowartificialanalysis.ai

Abstract Reasoning

Abstract Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
ARC-AGI-24.9scoreN/AIndependentlowepoch.ai

Reproduced by the community

Loading community runs…