Model
Gemma 7B
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| ANLI | 48.7 | score | N/A | Independent | medium | arxiv.org |
| BBH | 55.1 | average | N/A | Independent | medium | arxiv.org |
| BBH | 55.1 | average | N/A | Self-reported | medium | arxiv.org |
| BoolQ | 83.2 | score | N/A | Self-reported | medium | arxiv.org |
| EconLogicQA | 2.3 | accuracy | N/A | Independent | medium | arxiv.org |
| HellaSwag | 82.2 | overall_accuracy | N/A | Self-reported | medium | arxiv.org |
| MMLU | 66.1 | exact_match | N/A | Independent | medium | crfm.stanford.edu |
| MMLU | 64.3 | exact_match | N/A | Self-reported | medium | arxiv.org |
| OpenBookQA | 78.6 | accuracy | N/A | Independent | medium | arxiv.org |
| PIQA | 81.2 | score | N/A | Independent | medium | arxiv.org |
| PIQA | 81.2 | score | N/A | Self-reported | medium | arxiv.org |
| Trivia QA | 72.3 | exact_match | N/A | Independent | medium | arxiv.org |
| Trivia QA | 63.4 | exact_match | N/A | Self-reported | medium | arxiv.org |
| WinoGrande | 79.0 | accuracy | N/A | Self-reported | medium | arxiv.org |
| WinoGrande | 72.3 | accuracy | N/A | Independent | medium | arxiv.org |
Math
MathSafety & Alignment
Safety & AlignmentMultilingual
MultilingualReproduced by the community
Loading community runs…