Auto57%Harbor adapterMath

AIME 2024

Problems from the American Invitational Mathematics Examination

A benchmark for evaluating AI's ability to solve challenging mathematics problems from the 2024 AIME - a prestigious high school mathematics competition.

Dataset

How to run

ltb · aime-2024

$ npm i -g lettokenburn-cli
$ ltb bench pull aime-2024 --n 50
$ ltb bench run ./aime-2024 -a claude-code -m anthropic/claude-opus-4-8
$ ltb bench push

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

0 sourced entries

No sourced scores recorded yet.

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs

About

A benchmark for evaluating AI's ability to solve challenging mathematics problems from the 2024 AIME - a prestigious high school mathematics competition.

Facts

Metric: N/A
Scale: 0–100
Scoring: N/A
Format: Open-ended QA
Samples: 30
Difficulty: Medium
Saturation: Unknown
Languages: en
Modalities: text
Industries: Education
Released: N/A
HF dataset: Maxwell-Jia/AIME_2024

Data completeness

Auto57%

Auto: Extracted automatically and reviewed by an LLM; some fields may be missing.

Missing:

Paper link
Release date
Primary metric

Confirmed by 2 source channels. Fields are extracted automatically and can be wrong.

Report a correction ([email protected])

License

MITredistributable

auto-detected from Hugging Face dataset card

Citation. Cite the original authors via the links above.

Index record

Review status: auto published

Extraction confidence: 85%

Updated: Oct 2, 2026

JSON record

How to run

Scores

Reproduced by the community

About

Related benchmarks

AIME 2025

AIME 2026