Verified71%Harbor: pendingMultimodalInstruction Following

RISEBench

Reasoning-Informed Visual Editing Benchmark Plus Plus

Large Multi-modality Models (LMMs) have made significant progress in visual understanding and generation, but they still face challenges in General Visual Editing, particularly in following complex instructions, preserving appearance consistency, and supporting flexible input…

How to run

ltb · risebench
$ npm i -g lettokenburn-cli
$ ltb bench info risebench

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

13 sourced entries
HarnessSourceConfidenceLink
GPT-Image-2.5 Sunburst63.8N/AIndependentmediumOct 8, 2026arxiv.org
Nano Banana 260.4N/AIndependentmediumOct 8, 2026arxiv.org
Nano Banana Pro59.6N/AIndependentmediumOct 8, 2026arxiv.org
Luma Uni-157.5N/AIndependentmediumOct 8, 2026arxiv.org
GPT-Image-2.5 Flare57.1N/AIndependentmediumOct 8, 2026arxiv.org
GPT-Image-256.8N/AIndependentmediumOct 8, 2026arxiv.org
Nano Banana 2 Lite52.3N/AIndependentmediumOct 8, 2026arxiv.org
FLUX.2 Max49.8N/AIndependentmediumOct 8, 2026arxiv.org
GPT-Image-1.548.9N/AIndependentmediumOct 8, 2026arxiv.org
Qwen-Image-3.048.5N/AIndependentmediumOct 8, 2026arxiv.org
Nano Banana45.2N/AIndependentmediumOct 8, 2026arxiv.org
FLUX.2 Pro44.6N/AIndependentmediumOct 8, 2026arxiv.org
HunyuanImage-3.542.8N/AIndependentmediumOct 8, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

Large Multi-modality Models (LMMs) have made significant progress in visual understanding and generation, but they still face challenges in General Visual Editing, particularly in following complex instructions, preserving appearance consistency, and supporting flexible input formats. To study this gap, we introduce RISEBench, the first benchmark for evaluating Reasoning-Informed viSual Editing (RISE). RISEBench focuses on four key reasoning categories: Temporal, Causal, Spatial, and Logical Reasoning. We curate high-quality test cases for each category and propose an robust evaluation framework that assesses Instruction Reasoning, Appearance Consistency, and Visual Plausibility with both human judges and the LMM-as-a-judge approach. We conducted experiments evaluating nine prominent visual editing models, comprising both open-source and proprietary models. The evaluation results demonstrate that current models face significant challenges in reasoning-based editing tasks. Even the most powerful model evaluated, GPT-image-1, achieves an accuracy of merely 28.8%. RISEBench effectively highlights the limitations of contemporary editing models, provides valuable insights, and indicates potential future directions for the field of reasoning-aware visual editing. Our code and data have been released at https://github.com/PhoenixZ810/RISEBench.