LetTokenBurnBenchHub

Model

qwen3.5-9B

Alibaba · open weights

qwenlm.github.io

Knowledge & Reasoning

Knowledge & Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
CritPt	0.3	accuracy	N/A	Independent	low	epoch.ai
GPQA Diamond	79.0	accuracy	N/A	Independent	high	epoch.ai
LLM4Impact Dataset	2.0	rmse	zero-shot	Independent	medium	arxiv.org
Unanswerability Benchmark	0.8	auroc	N/A	Independent	medium	arxiv.org

Math

Benchmark	Score	Metric	Harness	Source	Confidence	Link
GraphDecide	99.8	accuracy	N/A	Independent	medium	arxiv.org

Coding

Benchmark	Score	Metric	Harness	Source	Confidence	Link
ChartRevise	94.3	exact-edit_rate	N/A	Independent	medium	arxiv.org
Closed-loop evaluation benchmark for embedded coding agents	13.3	pass_rate	N/A	Independent	medium	arxiv.org
Mobility Data Engineering Benchmark	69.3	success_rate	N/A	Independent	medium	arxiv.org
SciCode	27.5	score	N/A	Independent	medium	artificialanalysis.ai

Agentic / Tool Use

Agentic / Tool Use

Benchmark	Score	Metric	Harness	Source	Confidence	Link
Terminal-Bench	9.2	accuracy	little-coder	Independent	medium	tbench.ai

Multimodal

Benchmark	Score	Metric	Harness	Source	Confidence	Link
DSV-Mem	7.2	accuracy	N/A	Independent	medium	arxiv.org
EgoGears	21.1	accuracy	N/A	Independent	medium	arxiv.org
GeoSpatialBench	46.5	accuracy	N/A	Independent	medium	arxiv.org
MVGraph	13.5	accuracy	N/A	Independent	medium	arxiv.org
SpaceCast-Bench	34.6	accuracy	N/A	Independent	medium	arxiv.org
SpaceConflict	59.3	accuracy	N/A	Independent	medium	arxiv.org

Safety & Alignment

Safety & Alignment

Benchmark	Score	Metric	Harness	Source	Confidence	Link
OMIT	0.3	obr	N/A	Independent	medium	arxiv.org
Unified Misuse Monitoring Benchmark	0.9	auc	N/A	Independent	medium	arxiv.org

Abstract Reasoning

Abstract Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
FoldBench	0.2	tm-score	N/A	Independent	medium	arxiv.org
SyntaxBench	74.5	accuracy	N/A	Independent	medium	arxiv.org

Reproduced by the community