Model
BLOOM
Vendor N/A
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| ARC-Challenge | 32.9 | accuracy | N/A | Independent | medium | arxiv.org |
| ARC-Easy | 40.7 | accuracy | N/A | Independent | medium | arxiv.org |
| BoolQ | 70.4 | score | N/A | Independent | medium | crfm.stanford.edu |
| HellaSwag | 74.4 | overall_accuracy | N/A | Independent | medium | crfm.stanford.edu |
| medqa | 23.3 | accuracy | N/A | Independent | medium | arxiv.org |
| PubMedQA | 73.6 | accuracy | N/A | Independent | medium | arxiv.org |
Math
Math| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GSM8K | 9.5 | exact_match | N/A | Independent | medium | crfm.stanford.edu |
Reproduced by the community
Loading community runs…