Model
Llama-3.1-70B-Instruct
Meta · open weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Balrog | 27.9 | average_progress | N/A | Independent | medium | balrogai.com |
| BLiMPPI | 95.2 | accuracy | N/A | Independent | medium | arxiv.org |
| GPQA Diamond | 44.2 | accuracy | N/A | Independent | high | epoch.ai |
| MMLU | 80.1 | exact_match | N/A | Independent | medium | crfm.stanford.edu |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| AptMQL-Bench | 37.1 | soft-ex | N/A | Independent | medium | arxiv.org |
| ArchitectureIQ | 38.0 | accuracy | architectureiq | Independent | medium | arxiv.org |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| TALK-Dem | 69.0 | success_rate | N/A | Independent | medium | arxiv.org |
| TheAgentCompany | 6.9 | resolved_rate | N/A | Independent | medium | github.com |
Instruction Following
Instruction Following| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| CreativePreferences | 0.7 | auc | N/A | Independent | medium | arxiv.org |
Safety & Alignment
Safety & Alignment| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| OMIT | 0.1 | obr | N/A | Independent | medium | arxiv.org |
| PFaithBench | 29.2 | overans | N/A | Independent | medium | arxiv.org |
| Unified Misuse Monitoring Benchmark | 0.9 | auc | N/A | Independent | medium | arxiv.org |
Reproduced by the community
Loading community runs…