Auto86%Harbor: pendingMultimodalCoding

FigCodeBench

From Pixel to Coding: Evaluating the Figure Reproduction Capabilities of MLLMs

A benchmark with 6,194 instances evaluating MLLM figure reproduction across 7 categories and 4 languages (Python, Matlab, R, Latex) using visual and code metrics.

How to run

ltb · figcodebench
$ npm i -g lettokenburn-cli
$ ltb bench info figcodebench

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

13 sourced entries
HarnessSourceConfidenceLink
Gemini 3.1 Pro83.7N/AIndependentmediumOct 7, 2026arxiv.org
GPT-5.479.7N/AIndependentmediumOct 7, 2026arxiv.org
Gemini 3 Flash-TK78.5N/AIndependentmediumOct 7, 2026arxiv.org
Gemini 3 Flash Preview76.8N/AIndependentmediumOct 7, 2026arxiv.org
GPT-5.2-chat76.3N/AIndependentmediumOct 7, 2026arxiv.org
Claude Opus 4.776.2N/AIndependentmediumOct 7, 2026arxiv.org
GPT-5.4-mini75.2N/AIndependentmediumOct 7, 2026arxiv.org
Qwen3.6 Plus73.9N/AIndependentmediumOct 7, 2026arxiv.org
Grok-4.369.5N/AIndependentmediumOct 7, 2026arxiv.org
Gemini 2.5 Flash-TK58.8N/AIndependentmediumOct 7, 2026arxiv.org
Gemini 2.5 Flash55.8N/AIndependentmediumOct 7, 2026arxiv.org
GLM-4.6V50.2N/AIndependentmediumOct 7, 2026arxiv.org
GLM-5.144.2N/AIndependentmediumOct 7, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

FigCodeBench contains 6,194 figure-code pairs across Python, Matlab, R, and Latex, covering complex scientific figures. It uses a multi-dimensional protocol assessing visual fidelity (PSNR, SSIM) and syntactic isomorphism.

The benchmark reveals a universal performance cliff across models and languages, with Latex posing a significant bottleneck. It highlights gaps in 2D spatial reasoning and abstract set relationship representation in current MLLMs.