Model

BLOOM 176B

Vendor N/A

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
ARC-Challenge50.9accuracyN/AIndependentmediumarxiv.org
ARC-Easy75.9accuracyN/AIndependentmediumarxiv.org
BoolQ52.9accuracyN/AIndependentmediumarxiv.org
CommitmentBank48.2accuracyN/AIndependentmediumarxiv.org
commonsense_qa64.2accuracyN/AIndependentmediumarxiv.org
HellaSwag73.2accuracyN/AIndependentmediumarxiv.org
MMLU39.1average_(%)N/AIndependentmediumarxiv.org
MultiRC26.7f1N/AIndependentmediumarxiv.org
OpenBookQA47.2accuracyN/AIndependentmediumarxiv.org
PIQA77.0accuracyN/AIndependentmediumarxiv.org
RTE57.4accuracyN/AIndependentmediumarxiv.org
WinoGrande67.0accuracyN/AIndependentmediumarxiv.org

Multimodal

Multimodal
BenchmarkScoreMetricHarnessSourceConfidenceLink
COPA84.0accuracyN/AIndependentmediumarxiv.org

Reproduced by the community

Loading community runs…