Model
Anthropic-LM v4-s3
Vendor N/A
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| BoolQ | 81.5 | score | N/A | Independent | medium | crfm.stanford.edu |
| HellaSwag | 80.7 | overall_accuracy | N/A | Independent | medium | crfm.stanford.edu |
Math
Math| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GSM8K | 17.1 | exact_match | N/A | Independent | medium | crfm.stanford.edu |
Reproduced by the community
Loading community runs…