Auto86%Harbor: pendingAgentic / Tool UseKnowledge & Reasoning

Mine Odyssey

Mine Odyssey: Benchmarking Spatial Agentic Intelligence in the Wild

A benchmark evaluating agentic spatial intelligence via 180 navigation tasks across 30 Minecraft reconstructions of real-world locations.

How to run

ltb · mine-odyssey
$ npm i -g lettokenburn-cli
$ ltb bench info mine-odyssey

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

8 sourced entries
HarnessSourceConfidenceLink
GPT-6 Astra85.6N/AIndependentmediumOct 8, 2026arxiv.org
Claude Opus 5.573.9N/AIndependentmediumOct 8, 2026arxiv.org
Claude Opus 550.6N/AIndependentmediumOct 8, 2026arxiv.org
GPT-5.6 Sol43.9N/AIndependentmediumOct 8, 2026arxiv.org
Gemini 3.8 Flash26.7N/AIndependentmediumOct 8, 2026arxiv.org
DeepSeek V4.1 Flash23.9N/AIndependentmediumOct 8, 2026arxiv.org
Grok-4.617.2N/AIndependentmediumOct 8, 2026arxiv.org
GLM-5.3 Flash15.6N/AIndependentmediumOct 8, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

Comprises 180 tasks across 30 Minecraft maps of real-world sites (20 outdoor, 10 indoor) in 20 countries. Tasks require agents to follow natural-language instructions to visit ordered waypoints.

Success is measured by task completion rate. GPT-6 Astra leads with 85.6% success, while the best open-weight model reaches only 23.9%, indicating significant room for improvement.