Aider Polyglot
Harbor nativeAider Polyglot: 6种语言diff编辑
- Samples
- 225
- Released
- 2024
- Scores
- 61
GDPval measures model performance on economically valuable, real-world tasks across 44 occupations.
$ npm i -g lettokenburn-cli$ ltb bench pull gdpval
External harness. pip install inspect-evals && inspect eval inspect_evals/gdpval --model <provider/model> https://github.com/UKGovernmentBEIS/inspect_evals
License is link-only: ltb bench pull fetches rows from the original host for local evaluation only and does not write a solution/ directory. Do not redistribute the generated tasks.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
| Harness | Source | Confidence | Link | |||
|---|---|---|---|---|---|---|
| GPT-5.2-chat | 49.7 | N/A | Independent | low | N/A | epoch.ai |
| Claude Opus 4.5 (2025-11-01) | 45.5 | N/A | Independent | low | N/A | epoch.ai |
| Claude Opus 4.1 (2025-08-05) | 43.6 | N/A | Independent | low | N/A | epoch.ai |
| Claude Sonnet 4.5 (2025-09-29) | 42.5 | N/A | Independent | low | N/A | epoch.ai |
| Gemini 3 Pro | 40.3 | N/A | Independent | low | N/A | epoch.ai |
| GPT-5 | 34.8 | N/A | Independent | low | N/A | epoch.ai |
| o3 | 30.8 | N/A | Independent | low | N/A | epoch.ai |
| o4-mini | 25.3 | N/A | Independent | low | N/A | epoch.ai |
| Gemini 2.5 Pro | 23.3 | N/A | Independent | low | N/A | epoch.ai |
| Grok 4 0709 | 21.1 | N/A | Independent | low | N/A | epoch.ai |
| GPT-4o | 9.9 | N/A | Independent | low | N/A | epoch.ai |
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
GDPval measures model performance on economically valuable, real-world tasks across 44 occupations.