Model

INTELLECT-1-Instruct

Prime Intellect,Hugging Face,Arcee AI

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
BBH34.9averageN/ASelf-reportedmediumarxiv.org
HellaSwag71.4overall_accuracyN/ASelf-reportedmediumarxiv.org
MMLU49.9exact_matchN/ASelf-reportedmediumarxiv.org
WinoGrande65.8accuracyN/ASelf-reportedmediumarxiv.org

Math

Math
BenchmarkScoreMetricHarnessSourceConfidenceLink
GSM8K38.6exact_matchN/ASelf-reportedmediumarxiv.org

Reproduced by the community

Loading community runs…