LetTokenBurnBenchHub

Model

Mixtral 8x7B

Mistral AI · open weights

Knowledge & Reasoning

Knowledge & Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
ARC-Easy	83.1	accuracy	N/A	Independent	medium	arxiv.org
MMLU	70.6	average_(%)	N/A	Independent	medium	arxiv.org
PIQA	83.6	accuracy	N/A	Independent	medium	arxiv.org
WinoGrande	77.2	accuracy	N/A	Independent	medium	arxiv.org

Math

Benchmark	Score	Metric	Harness	Source	Confidence	Link
MATH	28.4	accuracy	N/A	Independent	medium	arxiv.org

Coding

Benchmark	Score	Metric	Harness	Source	Confidence	Link
MBPP	60.7	accuracy	N/A	Independent	medium	arxiv.org
PECC	8.3	pass@3	N/A	Independent	medium	arxiv.org

Safety & Alignment

Safety & Alignment

Benchmark	Score	Metric	Harness	Source	Confidence	Link
SynthPAI	52.3	average_accuracy_in_%	N/A	Independent	medium	arxiv.org

Multilingual

Benchmark	Score	Metric	Harness	Source	Confidence	Link
LingOly	6.4	delta_nocontext	N/A	Independent	medium	arxiv.org

Reproduced by the community