Model
MPT 7B
MosaicML
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| BBH | 35.6 | average | N/A | Independent | medium | arxiv.org |
| BoolQ | 75.0 | score | N/A | Independent | medium | arxiv.org |
| HellaSwag | 76.4 | overall_accuracy | N/A | Independent | medium | arxiv.org |
| LAMBADA | 70.0 | score | N/A | Independent | medium | arxiv.org |
| MMLU | 30.8 | exact_match | N/A | Independent | medium | arxiv.org |
| OpenBookQA | 51.4 | accuracy | N/A | Independent | medium | arxiv.org |
| PIQA | 80.6 | score | N/A | Independent | medium | arxiv.org |
| Trivia QA | 61.6 | exact_match | N/A | Independent | medium | arxiv.org |
| WinoGrande | 68.6 | accuracy | N/A | Independent | medium | arxiv.org |
Math
MathReproduced by the community
Loading community runs…