Model
OPT-175B
Vendor N/A
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| ARC-Challenge | 43.9 | accuracy | N/A | Independent | medium | arxiv.org |
| ARC-Easy | 71.0 | accuracy | N/A | Independent | medium | arxiv.org |
| BoolQ | 79.3 | score | N/A | Independent | medium | crfm.stanford.edu |
| BoolQ | 60.1 | accuracy | N/A | Independent | medium | arxiv.org |
| HellaSwag | 79.1 | overall_accuracy | N/A | Independent | medium | crfm.stanford.edu |
| LAMBADA | 75.6 | accuracy | N/A | Independent | medium | arxiv.org |
| PIQA | 81.1 | accuracy | N/A | Independent | medium | arxiv.org |
| RTE | 60.3 | accuracy | N/A | Independent | medium | arxiv.org |
| TruthfulQA | 21.0 | mc1 | N/A | Independent | medium | arxiv.org |
Math
Math| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GSM8K | 4.0 | exact_match | N/A | Independent | medium | crfm.stanford.edu |
Reproduced by the community
Loading community runs…