Verified86%Harbor: pendingAgentic / Tool UseMultimodal

RawVLA-Bench

RawVLA: Embodied Neural Image Signal Processor For Robotic Manipulation - RawVLA-Bench

RawVLA-Bench RawVLA-Bench is a paired training-trajectory dataset for studying RAW-domain visual frontends for vision-language-action (VLA) policies.

How to run

ltb · rawvla-bench
$ npm i -g lettokenburn-cli
$ ltb bench info rawvla-bench

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

4 sourced entries
HarnessSourceConfidenceLink
Qwen3-OFT97.8N/AIndependentmediumSep 29, 2026arxiv.org
Qwen3-PI96.8N/AIndependentmediumSep 29, 2026arxiv.org
WM4A-Wan93.8N/AIndependentmediumSep 29, 2026arxiv.org
WM4A-Cosmo41.2N/AIndependentmediumSep 29, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

RawVLA-Bench

RawVLA-Bench is a paired training-trajectory dataset for studying RAW-domain visual frontends for vision-language-action (VLA) policies. It is derived from successful expert trajectories in LIBERO and RoboTwin 2.0. Each trajectory has a RAW input version captured or rendered under a sampled lighting condition and a paired default-light RGB target. The pair shares the same trajectory identity, actions, robot states, frame count, and relative path. Failed trajectories…