Model
Gemma-2 27B
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GPQA Diamond | 36.5 | accuracy | N/A | Independent | high | epoch.ai |
| LiveBench | 38.2 | global_average | N/A | Independent | medium | livebench.ai |
| MMLU | 75.7 | exact_match | N/A | Independent | medium | crfm.stanford.edu |
| The Pile | 0.6 | bits_per_byte | N/A | Independent | medium | arxiv.org |
Reproduced by the community
Loading community runs…