Model
Gemma-2B-IT
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| BBH | 35.2 | average | N/A | Self-reported | medium | arxiv.org |
| BoolQ | 69.4 | score | N/A | Self-reported | medium | arxiv.org |
| EconLogicQA | 8.5 | accuracy | N/A | Independent | medium | arxiv.org |
| HellaSwag | 71.4 | overall_accuracy | N/A | Self-reported | medium | arxiv.org |
| MMLU | 42.3 | exact_match | N/A | Self-reported | medium | arxiv.org |
| PIQA | 77.3 | score | N/A | Self-reported | medium | arxiv.org |
| Trivia QA | 53.2 | exact_match | N/A | Self-reported | medium | arxiv.org |
| WinoGrande | 65.4 | accuracy | N/A | Self-reported | medium | arxiv.org |
Math
MathReproduced by the community
Loading community runs…