Auto86%Harbor: pendingMultimodalAbstract Reasoning

HSS

Humanity's Sixth Sense

A benchmark for intuitive visual reasoning in MLLMs using diverse image and video inputs with human-written prompts and atomic rubrics.

How to run

ltb · hss
$ npm i -g lettokenburn-cli
$ ltb bench info hss

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

13 sourced entries
HarnessSourceConfidenceLink
GPT-6 Astra53.6N/AIndependentmediumOct 6, 2026arxiv.org
GPT-6.1 Sol46.6N/AIndependentmediumOct 6, 2026arxiv.org
Claude Opus 5.544.6N/AIndependentmediumOct 6, 2026arxiv.org
Gemini 3.8 Flash41.6N/AIndependentmediumOct 6, 2026arxiv.org
Claude Fable 5.140.8N/AIndependentmediumOct 6, 2026arxiv.org
Gemini 3.7 Flash39.8N/AIndependentmediumOct 6, 2026arxiv.org
Muse Spark 1.337.4N/AIndependentmediumOct 6, 2026arxiv.org
Claude Fable 534.5N/AIndependentmediumOct 6, 2026arxiv.org
Qwen3.8 Max33.0N/AIndependentmediumOct 6, 2026arxiv.org
Gemini-3.5-flash32.6N/AIndependentmediumOct 6, 2026arxiv.org
Gemini 3.6 Flash31.9N/AIndependentmediumOct 6, 2026arxiv.org
GPT-6 Sol31.2N/AIndependentmediumOct 6, 2026arxiv.org
Qwen3.8 Flash30.9N/AIndependentmediumOct 6, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

HSS evaluates implicit visual inference across temporal, spatial, social, and abstract domains using open-ended tasks. Items are human-authored and verified via multi-stage review to ensure consensus.

Scoring uses atomic rubrics where all criteria must be met for a correct answer. Humans achieve 93.1% accuracy, while the best model (GPT-6-astra) reaches only 53.6%, indicating a significant capability gap.