Model
MPT 30B
MosaicML
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| BBH | 38.0 | average | N/A | Independent | medium | arxiv.org |
| BoolQ | 85.0 | score | N/A | Independent | medium | crfm.stanford.edu |
| MMLU | 47.9 | exact_match | N/A | Independent | medium | arxiv.org |
| OpenBookQA | 52.0 | accuracy | N/A | Independent | medium | arxiv.org |
| PIQA | 81.9 | score | N/A | Independent | medium | arxiv.org |
| Trivia QA | 73.6 | exact_match | N/A | Independent | medium | arxiv.org |
| WinoGrande | 71.0 | accuracy | N/A | Independent | medium | arxiv.org |
Math
Math| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GSM8K | 34.4 | exact_match | N/A | Independent | medium | crfm.stanford.edu |
Reproduced by the community
Loading community runs…