Model

Qwen 7B

Alibaba · open weights

qwenlm.github.io

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
BBH45.0averageN/ASelf-reportedmediumarxiv.org
BoolQ76.4scoreN/ASelf-reportedmediumarxiv.org
LAMBADA67.9scoreN/ASelf-reportedmediumarxiv.org
MMLU56.7average_(%)N/AIndependentmediumpaperswithcode.com
MMLU45.0exact_matchN/ASelf-reportedmediumarxiv.org
PIQA77.9scoreN/ASelf-reportedmediumarxiv.org

Math

Math
BenchmarkScoreMetricHarnessSourceConfidenceLink
GSM8K54.1exact_matchN/ASelf-reportedmediumarxiv.org
GSM8K51.7exact_matchN/AIndependentmediumarxiv.org

Reproduced by the community

Loading community runs…