Model

LLaMA 33B

Meta · open weights

Knowledge & Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
ARC-Challenge	57.8	accuracy	N/A	Independent	medium	arxiv.org
ARC-Easy	80.0	accuracy	N/A	Independent	medium	arxiv.org
BBH	50.0	average	N/A	Independent	medium	arxiv.org
BBH	39.8	average	N/A	Self-reported	medium	arxiv.org
BoolQ	86.1	score	N/A	Independent	medium	crfm.stanford.edu
BoolQ	83.1	accuracy	N/A	Independent	medium	arxiv.org
BoolQ	83.1	score	N/A	Self-reported	medium	arxiv.org
HellaSwag	82.8	accuracy	N/A	Independent	medium	arxiv.org
HellaSwag	82.8	overall_accuracy	N/A	Self-reported	medium	arxiv.org
LAMBADA	77.2	score	N/A	Independent	medium	arxiv.org
MMLU	58.7	exact_match	N/A	Independent	medium	arxiv.org
MMLU	57.8	average_(%)	N/A	Independent	medium	arxiv.org
MMLU	57.8	exact_match	N/A	Self-reported	medium	arxiv.org
Natural Questions	24.9	exact_match	N/A	Independent	medium	arxiv.org
OpenBookQA	58.6	accuracy	N/A	Self-reported	medium	arxiv.org
OpenBookQA	58.6	accuracy	N/A	Independent	medium	arxiv.org
PIQA	82.3	accuracy	N/A	Independent	medium	arxiv.org
PIQA	82.3	score	N/A	Self-reported	medium	arxiv.org
PIQA	82.3	score	N/A	Independent	medium	arxiv.org
siqa	50.4	accuracy	N/A	Independent	medium	arxiv.org
Trivia QA	83.8	exact_match	N/A	Self-reported	medium	arxiv.org
WinoGrande	76.0	accuracy	N/A	Independent	medium	arxiv.org
WinoGrande	76.0	accuracy	N/A	Self-reported	medium	arxiv.org

Benchmark	Score	Metric	Harness	Source	Confidence	Link
GSM8K	44.1	exact_match	N/A	Independent	medium	arxiv.org
GSM8K	35.6	accuracy	N/A	Independent	medium	arxiv.org
GSM8K	35.6	exact_match	N/A	Self-reported	medium	arxiv.org
MATH	7.1	accuracy	N/A	Independent	medium	arxiv.org

Benchmark	Score	Metric	Harness	Source	Confidence	Link
MBPP	30.2	accuracy	N/A	Independent	medium	arxiv.org