ARC-AGI-2
Harbor nativeARC-AGI-2: 更难的抽象推理
- Samples
- 167
- Released
- 2025
- Scores
- 120
HAPACT: A Benchmark For Human-Centric Physical Impact Localization in Movies
A video benchmark for localizing physical impacts temporally and spatially on the human body, containing 2.8K video-query pairs from movies with SMPL-X annotations.
$ npm i -g lettokenburn-cli$ ltb bench info hapact
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
| Harness | Source | Confidence | Link | |||
|---|---|---|---|---|---|---|
| GPT-5.4 | 42.6 | N/A | Independent | medium | Oct 16, 2026 | arxiv.org |
| GPT-4o | 28.9 | N/A | Independent | medium | Oct 16, 2026 | arxiv.org |
| Gemini 3.1 Pro | 27.2 | N/A | Independent | medium | Oct 16, 2026 | arxiv.org |
| Qwen3-VL-8B-Instruct | 22.9 | N/A | Independent | medium | Oct 16, 2026 | arxiv.org |
| Qwen3-VL-32B | 21.4 | N/A | Independent | medium | Oct 16, 2026 | arxiv.org |
| InternVL3.5-8B-Instruct | 14.0 | N/A | Independent | medium | Oct 16, 2026 | arxiv.org |
| Grounded-Video-LLM | 8.0 | N/A | Independent | medium | Oct 16, 2026 | arxiv.org |
| UniTime | 7.9 | N/A | Independent | medium | Oct 16, 2026 | arxiv.org |
| TimeLens | 5.1 | N/A | Independent | medium | Oct 16, 2026 | arxiv.org |
| TRACE | 4.2 | N/A | Independent | medium | Oct 16, 2026 | arxiv.org |
| VTimeLLM | 1.0 | N/A | Independent | medium | Oct 16, 2026 | arxiv.org |
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
HAPACT comprises over 2.8K video-query pairs from 212 movies, featuring frame-level temporal and SMPL-X spatial annotations for human-centric impact events. It evaluates temporal retrieval and spatial localization, showing that existing methods struggle with fine-grained impact reasoning.