AIME 2025
Harbor adapterAIME 2025: 30道AIME级数学题
- Samples
- 30
- Released
- 2025
- Scores
- 12
$ npm i -g lettokenburn-cli$ ltb bench run aider/aider-polyglot@1 --benchmark aider-polyglot -a claude-code -m anthropic/claude-opus-4-8$ ltb bench push
Harbor-native: you can also call Harbor directly.
$ harbor run -d aider/aider-polyglot@1 -a claude-code -m anthropic/claude-opus-4-8
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
| Harness | Source | Confidence | Link | |||
|---|---|---|---|---|---|---|
| GPT-5 | 88.0 | N/A | Independent | medium | Aug 23, 2025 | aider.chat |
| o3-pro-2025-06-10 | 84.9 | N/A | Independent | medium | Jun 28, 2025 | aider.chat |
| gemini-2.5-pro-preview-06-05-32K | 83.1 | N/A | Independent | medium | Jun 6, 2025 | aider.chat |
| o3 | 81.3 | N/A | Independent | medium | Jun 25, 2025 | aider.chat |
| Grok 4 0709 | 79.6 | N/A | Independent | medium | N/A | aider.chat |
| Gemini 2.5 Pro Preview 06-05 | 79.1 | N/A | Independent | medium | Jun 6, 2025 | aider.chat |
| Gemini 2.5 Pro Preview 05-06 | 76.9 | N/A | Independent | medium | May 7, 2025 | aider.chat |
| DeepSeek Reasoner | 74.2 | N/A | Independent | medium | Oct 3, 2025 | aider.chat |
| DeepSeek V3.2 | 74.2 | N/A | Independent | medium | N/A | aider.chat |
| Gemini 2.5 Pro Preview 03-25 | 72.9 | N/A | Independent | medium | Apr 12, 2025 | aider.chat |
| Gemini 2.5 Pro Exp 03-25 | 72.9 | N/A | Independent | medium | N/A | aider.chat |
| claude-opus-4-20250514-32K | 72.0 | N/A | Independent | medium | May 25, 2025 | aider.chat |
| o4-mini | 72.0 | N/A | Independent | medium | Apr 16, 2025 | aider.chat |
| DeepSeek-R1-0528 | 71.4 | N/A | Independent | medium | Jun 6, 2025 | aider.chat |
| Claude Opus 4 (2025-05-14) | 70.7 | N/A | Independent | medium | May 25, 2025 | aider.chat |
| DeepSeek Chat | 70.2 | N/A | Independent | medium | Oct 3, 2025 | aider.chat |
| claude-3-7-sonnet-20250219-32K | 64.9 | N/A | Independent | medium | Feb 24, 2025 | aider.chat |
| OpenAI/o1-2024-12-17-high | 61.7 | N/A | Independent | medium | Dec 21, 2024 | aider.chat |
| claude-sonnet-4-20250514-32K | 61.3 | N/A | Independent | medium | May 24, 2025 | aider.chat |
| Claude 3.7 Sonnet Thinking (2025-02-19) | 60.4 | N/A | Independent | medium | Feb 24, 2025 | aider.chat |
| o3-mini | 60.4 | N/A | Independent | medium | Jan 31, 2025 | aider.chat |
| Qwen3-235B-A22B-Thinking-2507 | 59.6 | N/A | Independent | medium | May 9, 2025 | aider.chat |
| Qwen3 235B A22B | 59.6 | N/A | Independent | medium | N/A | aider.chat |
| Kimi K2 0905 | 59.1 | N/A | Independent | medium | Jul 17, 2025 | aider.chat |
| Kimi K2 Thinking Turbo | 59.1 | N/A | Independent | medium | N/A | aider.chat |
| DeepSeek R1 | 56.9 | N/A | Independent | medium | Jan 20, 2025 | aider.chat |
| Claude Sonnet 4 (2025-05-14) | 56.4 | N/A | Independent | medium | May 24, 2025 | aider.chat |
| gemini-2.5-flash-preview-05-20-23K | 55.1 | N/A | Independent | medium | May 25, 2025 | aider.chat |
| DeepSeek V3 0324 | 55.1 | N/A | Independent | medium | Mar 24, 2025 | aider.chat |
| Grok 3 | 53.3 | N/A | Independent | medium | Apr 10, 2025 | aider.chat |
| GPT-4.1 | 52.4 | N/A | Independent | medium | Apr 14, 2025 | aider.chat |
| Claude 3.5 Sonnet | 51.6 | N/A | Independent | medium | Jan 17, 2025 | aider.chat |
| Grok 3 Mini Beta | 49.3 | N/A | Independent | medium | Apr 10, 2025 | aider.chat |
| DeepSeek-V3 | 48.4 | N/A | Independent | medium | N/A | aider.chat |
| Gemini 2.5 Flash Preview 04-17 | 47.1 | N/A | Independent | medium | Apr 20, 2025 | aider.chat |
| ChatGPT-4o (2025-03-27) | 45.3 | N/A | Independent | medium | Mar 29, 2025 | aider.chat |
| GPT-4.5 Preview (2025-02-27) | 44.9 | N/A | Independent | medium | Feb 27, 2025 | aider.chat |
| Gemini 2.5 Flash Preview 05-20 | 44.0 | N/A | Independent | medium | May 26, 2025 | aider.chat |
| GPT-oss 120B | 41.8 | N/A | Independent | medium | N/A | epoch.ai |
| Qwen3-32B | 40.0 | N/A | Independent | medium | May 8, 2025 | aider.chat |
| Gemini Exp 1206 | 38.2 | N/A | Independent | medium | Dec 22, 2024 | aider.chat |
| Gemini 2.0 Pro Exp 02-05 | 35.6 | N/A | Independent | medium | Feb 25, 2025 | aider.chat |
| o1-mini | 32.9 | N/A | Independent | medium | Dec 22, 2024 | aider.chat |
| GPT-4.1-mini | 32.4 | N/A | Independent | medium | Apr 14, 2025 | aider.chat |
| Claude 3.5 Haiku (2024-10-22) | 28.0 | N/A | Independent | medium | Dec 21, 2024 | aider.chat |
| ChatGPT-4o (2025-01-29) | 27.1 | N/A | Independent | medium | Feb 15, 2025 | aider.chat |
| GPT-4o | 23.1 | N/A | Independent | medium | Dec 30, 2024 | aider.chat |
| Gemini 2.0 Flash Experimental | 22.2 | N/A | Independent | medium | Dec 22, 2024 | aider.chat |
| Qwen Max (2025-01-25) | 21.8 | N/A | Independent | medium | Jan 28, 2025 | aider.chat |
| QwQ-32B | 20.9 | N/A | Independent | medium | Mar 6, 2025 | aider.chat |
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
Aider Polyglot (Aider Polyglot) — 6种语言diff编辑. Scoring: Pass rate. Difficulty: 高. Imported from benchmark_research.md (2026-06).