Model
Claude Instant 1.2
Anthropic · closed weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| MMLU | 73.2 | exact_match | N/A | Self-reported | medium | anthropic.com |
| MMLU | 68.8 | exact_match | N/A | Independent | medium | crfm.stanford.edu |
| Trivia QA | 78.7 | exact_match | N/A | Self-reported | medium | anthropic.com |
Math
Math| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GSM8K | 86.7 | exact_match | N/A | Self-reported | medium | anthropic.com |
Reproduced by the community
Loading community runs…