Model
OPT 1.3B
Vendor N/A
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| BoolQ | 62.5 | test_accuracy | N/A | Independent | medium | arxiv.org |
| BoolQ | 60.5 | accuracy | N/A | Independent | medium | arxiv.org |
| BoolQ | 59.6 | score | N/A | Independent | medium | arxiv.org |
| HellaSwag | 41.5 | overall_accuracy | N/A | Independent | medium | arxiv.org |
| OpenBookQA | 24.0 | accuracy | N/A | Independent | medium | arxiv.org |
| PIQA | 69.0 | score | N/A | Independent | medium | arxiv.org |
| RTE | 60.9 | test_accuracy | N/A | Independent | medium | arxiv.org |
| RTE | 54.2 | accuracy | N/A | Independent | medium | arxiv.org |
| WiC | 56.1 | test_accuracy | N/A | Independent | medium | arxiv.org |
| WinoGrande | 61.0 | accuracy | N/A | Independent | medium | arxiv.org |
| WSC | 64.2 | test_accuracy | N/A | Independent | medium | arxiv.org |
Reproduced by the community
Loading community runs…