Model

Mistral

Mistral AI · open weights

mistral.ai

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
MS-Exam-Gen71.8accuracyN/AIndependentmediumarxiv.org
TPBench0.7accuracyN/AIndependentmediumarxiv.org
VaccineStance55.6f1N/AIndependentmediumarxiv.org

Multimodal

Multimodal
BenchmarkScoreMetricHarnessSourceConfidenceLink
AVSD-Scenes72.1avg.N/AIndependentmediumarxiv.org
IntentQA50.4accuracyN/AIndependentmediumarxiv.org
NExT-GQA9.2acc@gqaN/AIndependentmediumarxiv.org
NExT-QA51.1accuracyN/AIndependentmediumarxiv.org
VisAudit56.7recovery_rateN/AIndependentmediumarxiv.org

Safety & Alignment

Safety & Alignment
BenchmarkScoreMetricHarnessSourceConfidenceLink
rt-inod-jailbreaking87.0best-ofN/AIndependentmediumarxiv.org

Reproduced by the community

Loading community runs…