Model

Pythia 12B

Vendor N/A

Knowledge & Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
ARC-Challenge	36.8	accuracy	N/A	Independent	medium	arxiv.org
ARC-Challenge	31.8	accuracy	N/A	Independent	medium	arxiv.org
ARC-Easy	71.5	accuracy	N/A	Independent	medium	arxiv.org
ARC-Easy	70.2	accuracy	N/A	Independent	medium	arxiv.org
LAMBADA	70.5	accuracy	N/A	Independent	medium	arxiv.org
PIQA	76.7	accuracy	N/A	Independent	medium	arxiv.org
PIQA	76.0	accuracy	N/A	Independent	medium	arxiv.org
WinoGrande	66.6	accuracy	N/A	Independent	medium	arxiv.org
WinoGrande	63.9	accuracy	N/A	Independent	medium	arxiv.org
WSC	54.8	accuracy	N/A	Independent	medium	arxiv.org
WSC	36.5	accuracy	N/A	Independent	medium	arxiv.org