Model

GPT-3-175B

OpenAI · closed weights

Knowledge & Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
ARC-Challenge	53.2	accuracy	N/A	Independent	medium	arxiv.org
ARC-Challenge	51.4	accuracy	N/A	Independent	medium	arxiv.org
ARC-Easy	71.2	accuracy	N/A	Independent	medium	arxiv.org
ARC-Easy	68.8	accuracy	N/A	Independent	medium	arxiv.org
BoolQ	76.4	accuracy	N/A	Independent	medium	arxiv.org
BoolQ	60.5	score	N/A	Independent	medium	arxiv.org
CommitmentBank	75.6	accuracy	N/A	Independent	medium	arxiv.org
HellaSwag	79.3	accuracy	N/A	Independent	medium	arxiv.org
LAMBADA	86.4	accuracy	N/A	Independent	medium	arxiv.org
LAMBADA	76.2	accuracy	N/A	Independent	medium	arxiv.org
LAMBADA	76.2	score	N/A	Independent	medium	arxiv.org
MultiRC	75.4	f1	N/A	Independent	medium	arxiv.org
Natural Questions	29.9	exact_match	N/A	Independent	medium	arxiv.org
OpenBookQA	65.4	accuracy	N/A	Independent	medium	arxiv.org
OpenBookQA	57.6	accuracy	N/A	Independent	medium	arxiv.org
PIQA	81.0	accuracy	N/A	Independent	medium	arxiv.org
Qu AC	44.3	f1	N/A	Independent	medium	arxiv.org
RTE	69.0	accuracy	N/A	Independent	medium	arxiv.org
StoryCloze	87.7	accuracy	N/A	Independent	medium	arxiv.org
Trivia QA	71.2	exact_match	N/A	Independent	medium	arxiv.org
TruthfulQA	21.0	mc1	N/A	Independent	medium	arxiv.org
WebQuestions	41.5	exact_match	N/A	Independent	medium	arxiv.org
WebQuestions	25.3	exact_match	N/A	Independent	medium	arxiv.org
WebQuestions	14.4	exact_match	N/A	Independent	medium	arxiv.org
WiC	49.4	accuracy	N/A	Independent	medium	arxiv.org
WinoGrande	70.2	accuracy	N/A	Independent	medium	arxiv.org
WSC	80.1	accuracy	N/A	Independent	medium	arxiv.org

Benchmark	Score	Metric	Harness	Source	Confidence	Link
MATH	5.2	accuracy	N/A	Independent	medium	arxiv.org
MATH	5.2	accuracy	N/A	Independent	medium	arxiv.org

Benchmark	Score	Metric	Harness	Source	Confidence	Link
COPA	92.0	accuracy	N/A	Independent	medium	arxiv.org
COPA	91.0	accuracy	N/A	Independent	medium	arxiv.org
COPA	87.0	accuracy	N/A	Independent	medium	arxiv.org