LetTokenBurnBenchHub

Model

PaLM 62B

Google

deepmind.google

Knowledge & Reasoning

Knowledge & Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
BoolQ	84.8	score	N/A	Independent	medium	arxiv.org
MMLU	53.7	exact_match	N/A	Independent	medium	arxiv.org
OpenBookQA	50.4	accuracy	N/A	Independent	medium	arxiv.org
OpenBookQA	50.4	accuracy	N/A	Independent	medium	arxiv.org
PIQA	80.5	score	N/A	Independent	medium	arxiv.org
WinoGrande	77.0	accuracy	N/A	Independent	medium	arxiv.org
WinoGrande	77.0	accuracy	N/A	Independent	medium	arxiv.org
WinoGrande	77.0	accuracy	N/A	Self-reported	medium	jmlr.org

Math

Benchmark	Score	Metric	Harness	Source	Confidence	Link
GSM8K	33.0	accuracy	N/A	Independent	medium	arxiv.org
GSM8K	33.0	exact_match	N/A	Independent	medium	arxiv.org
MATH	4.4	accuracy	N/A	Independent	medium	arxiv.org

Reproduced by the community