Auto86%Harbor: pendingMultimodalInstruction Following

VisSlideBench

A benchmark of 1,527 manually screened instances for evaluating single-slide image generation and editing across four tasks with multidimensional metrics.

How to run

ltb · visslidebench
$ npm i -g lettokenburn-cli
$ ltb bench info visslidebench

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

8 sourced entries
HarnessSourceConfidenceLink
GPT-Image-28.4N/AIndependentmediumOct 12, 2026arxiv.org
Nano Banana 28.0N/AIndependentmediumOct 12, 2026arxiv.org
Qwen-Image-26.5N/AIndependentmediumOct 12, 2026arxiv.org
FLUX.2-dev6.4N/AIndependentmediumOct 12, 2026arxiv.org
FLUX.2-klein-9B6.3N/AIndependentmediumOct 12, 2026arxiv.org
HiDream-O1-Image4.8N/AIndependentmediumOct 12, 2026arxiv.org
BAGEL4.4N/AIndependentmediumOct 12, 2026arxiv.org
OmniGen24.1N/AIndependentmediumOct 12, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

VisSlideBench contains 1,527 instances covering text-to-slide, template-conditioned, multi-image grounded generation, and instruction-based editing. It evaluates content faithfulness, instruction following, aesthetic quality, semantic consistency, and presentation quality.

Scoring uses automatic evaluators validated against blinded human rankings. InfoVis achieves a leading overall score of 7.94 on this benchmark, outperforming other open-source models across eleven metrics.