Verified86%Harbor: pendingMultimodalAbstract Reasoning

Knossos

A benchmark of 19,200 synthetic structural diagrams across six domains for evaluating complete diagram-to-graph topology extraction.

How to run

ltb · knossos
$ npm i -g lettokenburn-cli
$ ltb bench info knossos

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

12 sourced entries
HarnessSourceConfidenceLink
Ariadne91.6N/AIndependentmediumOct 3, 2026arxiv.org
GPT-5.681.1N/AIndependentmediumOct 3, 2026arxiv.org
Claude Opus 570.4N/AIndependentmediumOct 3, 2026arxiv.org
Qwen3-VL-32B54.7N/AIndependentmediumOct 3, 2026arxiv.org
TopoAgent46.5N/AIndependentmediumOct 3, 2026arxiv.org
Qwen3-VL-8B-Instruct46.1N/AIndependentmediumOct 3, 2026arxiv.org
Speculative Verdict43.9N/AIndependentmediumOct 3, 2026arxiv.org
GPT-4o41.2N/AIndependentmediumOct 3, 2026arxiv.org
InternVL3.5-8B-Instruct40.7N/AIndependentmediumOct 3, 2026arxiv.org
MiMo-VL-7B-SFT40.7N/AIndependentmediumOct 3, 2026arxiv.org
Keye-VL-1.5-8B39.0N/AIndependentmediumOct 3, 2026arxiv.org
Ovis2.5-9B38.3N/AIndependentmediumOct 3, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

Knossos contains 19,200 synthetic diagrams from six domains (e.g., Food Web, Circuit) with exact annotations for nodes, typed edges, and connector geometry. It enables supervised training and evaluation of vision-language models on complete topology extraction tasks.

Evaluation uses Edge F1 to measure the accuracy of extracted graph structures. Models trained on Knossos show substantial improvements in topology extraction, with the Ariadne framework achieving the highest average Edge F1 among evaluated methods.