Model

Pythia

Vendor N/A

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
BoolQ66.2scoreN/AIndependentmediumcrfm.stanford.edu

Math

Math
BenchmarkScoreMetricHarnessSourceConfidenceLink
GSM8K3.2exact_matchN/AIndependentmediumcrfm.stanford.edu

Multimodal

Multimodal
BenchmarkScoreMetricHarnessSourceConfidenceLink
AOKVQA40.1mc_accuracyN/AIndependentmediumarxiv.org

Reproduced by the community

Loading community runs…