Model

Mistral-7B-v0.1

Mistral AI · open weights

mistral.ai

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
ANLI47.1scoreN/AIndependentmediumarxiv.org
BBH56.1averageN/AIndependentmediumarxiv.org
BoolQ87.4scoreN/AIndependentmediumcrfm.stanford.edu
EconLogicQA26.1accuracyN/AIndependentmediumarxiv.org
HellaSwag81.0overall_accuracyN/AIndependentmediumarxiv.org
MMLU62.5exact_matchN/AIndependentmediumarxiv.org
OpenBookQA79.8accuracyN/AIndependentmediumarxiv.org
PIQA83.0scoreN/AIndependentmediumarxiv.org
Trivia QA75.2exact_matchN/AIndependentmediumarxiv.org
WinoGrande75.3accuracyN/AIndependentmediumarxiv.org

Math

Math
BenchmarkScoreMetricHarnessSourceConfidenceLink
GSM8K54.4exact_matchN/AIndependentmediumarxiv.org

Reproduced by the community

Loading community runs…