Model
Claude Instant 1.1
Anthropic · closed weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| ARC-Challenge | 85.7 | accuracy | N/A | Independent | medium | www-files.anthropic.com |
| MMLU | 73.4 | exact_match | N/A | Self-reported | medium | www-cdn.anthropic.com |
| Trivia QA | 78.9 | exact_match | N/A | Self-reported | medium | www-cdn.anthropic.com |
| Trivia QA | 78.9 | exact_match | N/A | Independent | medium | www-files.anthropic.com |
Math
Math| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GSM8K | 80.9 | exact_match | N/A | Self-reported | medium | anthropic.com |
Long Context
Long Context| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| QuALITY | 80.5 | accuracy | N/A | Independent | medium | www-files.anthropic.com |
Reproduced by the community
Loading community runs…