ARC-AGI-2
Harbor nativeARC-AGI-2: 更难的抽象推理
- Samples
- 167
- Released
- 2025
- Scores
- 118
Personal-Agent Mediated Recommendation with Cross-Platform User History
A benchmark for personal-agent mediated recommendation using scalable proxy environments (Amazon Reviews) and a real cross-platform test to evaluate rescue-harm trade-offs.
$ npm i -g lettokenburn-cli$ ltb bench info mediaterec
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
| Harness | Source | Confidence | Link | |||
|---|---|---|---|---|---|---|
| Claude Opus 4.6 | 13.6 | N/A | Independent | medium | Oct 6, 2026 | arxiv.org |
| Claude Sonnet 4.6 | 13.5 | N/A | Independent | medium | Oct 6, 2026 | arxiv.org |
| Claude Haiku 4.5 | 12.2 | N/A | Independent | medium | Oct 6, 2026 | arxiv.org |
| Qwen3 4B | 8.5 | N/A | Independent | medium | Oct 6, 2026 | arxiv.org |
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
MediateRec constructs controlled platform–agent information boundaries using Amazon Reviews for proxy environments and linked activity data for real cross-platform testing. It evaluates how well personal agents use cross-platform history to correct platform rankings without introducing harmful overrides.
Scoring focuses on the balance between beneficial rescues and harmful overrides compared to platform baselines. Experiments show that while LLMs can make meaningful corrections, they still introduce non-negligible harmful overrides, highlighting the need for optimized mediation strategies like PAMO.