Auto86%Harbor: pendingCodingAgentic / Tool Use

WebUIProof

WebUIProof: Benchmarking WebUI Code Generators with UI-Agent Execution Harness

An execution-oriented benchmark with 219 tasks and 3k executable interaction tests measuring functional correctness of WebUI code generation via a UI-agent harness.

How to run

ltb · webuiproof
$ npm i -g lettokenburn-cli
$ ltb bench info webuiproof

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

10 sourced entries
HarnessSourceConfidenceLink
Claude Sonnet 4 (2025-05-14)46.1N/AIndependentmediumOct 2, 2026arxiv.org
Gemini 2.5 Pro42.9N/AIndependentmediumOct 2, 2026arxiv.org
Qwen 3 Coder 480B42.0N/AIndependentmediumOct 2, 2026arxiv.org
DeepSeek R141.9N/AIndependentmediumOct 2, 2026arxiv.org
GPT-4.141.4N/AIndependentmediumOct 2, 2026arxiv.org
Llama 4 Maverick40.8N/AIndependentmediumOct 2, 2026arxiv.org
Kimi K2 Thinking Turbo39.3N/AIndependentmediumOct 2, 2026arxiv.org
Llama 3 405B36.2N/AIndependentmediumOct 2, 2026arxiv.org
Qwen2.5 14B Instruct26.1N/AIndependentmediumOct 2, 2026arxiv.org
MIMO 7B23.8N/AIndependentmediumOct 2, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

WebUIProof contains 219 tasks (149 general, 70 3D) with structured specifications and 3,000 executable interaction tests. It evaluates WebUI code generators by running tests in a headless browser using an iterative plan-act-observe loop.

Scoring relies on the success rate of UI-agent executed assertions checking DOM changes and behavior. Evaluation of eight commercial LLMs reveals frequent failures on interaction requirements despite successful rendering, especially for 3D simulations.