Model

PaLM 8B

Google

Knowledge & Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
MMLU	25.4	exact_match	N/A	Independent	medium	arxiv.org

Benchmark	Score	Metric	Harness	Source	Confidence	Link
GSM8K	4.1	accuracy	N/A	Independent	medium	arxiv.org
GSM8K	4.1	exact_match	N/A	Independent	medium	arxiv.org
MATH	1.5	accuracy	N/A	Independent	medium	arxiv.org