LetTokenBurnBenchHub

Model

Falcon 40B

TII · open weights

falconllm.tii.ae

Knowledge & Reasoning

Knowledge & Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
BBH	37.1	average	N/A	Independent	medium	arxiv.org
BoolQ	83.1	score	N/A	Independent	medium	arxiv.org
BoolQ	81.9	score	N/A	Self-reported	medium	arxiv.org
HellaSwag	85.3	overall_accuracy	N/A	Self-reported	medium	arxiv.org
HellaSwag	82.7	accuracy	N/A	Independent	medium	arxiv.org
LAMBADA	77.3	score	N/A	Self-reported	medium	arxiv.org
MMLU	57.0	average_(%)	N/A	Independent	medium	arxiv.org
MMLU	56.9	exact_match	N/A	Self-reported	medium	arxiv.org
MMLU	55.4	exact_match	N/A	Independent	medium	arxiv.org
OpenBookQA	56.6	accuracy	N/A	Independent	medium	arxiv.org
PIQA	83.0	score	N/A	Self-reported	medium	arxiv.org
PIQA	82.4	score	N/A	Independent	medium	arxiv.org
Trivia QA	79.9	exact_match	N/A	Independent	medium	arxiv.org
WinoGrande	76.9	accuracy	N/A	Independent	medium	arxiv.org
WinoGrande	76.4	accuracy	N/A	Self-reported	medium	arxiv.org

Math

Benchmark	Score	Metric	Harness	Source	Confidence	Link
GSM8K	33.8	exact_match	N/A	Independent	medium	crfm.stanford.edu
GSM8K	21.5	exact_match	N/A	Self-reported	medium	arxiv.org

Reproduced by the community