Model

llama 2

Meta · open weights

ai.meta.com

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
medqa59.2accuracyN/AIndependentmediumarxiv.org
MMLU73.5average_(%)N/AIndependentmediumarxiv.org
MultiTQ18.5hits@1N/AIndependentmediumarxiv.org

Math

Math
BenchmarkScoreMetricHarnessSourceConfidenceLink
MAWPS82.4accuracy_(%)N/AIndependentmediumarxiv.org
SVAMP69.2execution_accuracyN/AIndependentmediumarxiv.org

Safety & Alignment

Safety & Alignment
BenchmarkScoreMetricHarnessSourceConfidenceLink
rt-inod-jailbreaking86.0best-ofN/AIndependentmediumarxiv.org

Reproduced by the community

Loading community runs…