Auto57%Harbor: pendingMultimodalAgentic / Tool Use

LIBERO-Para

LIBERO-Para: A Diagnostic Benchmark and Metrics for Paraphrase Robustness in VLA Models LIBERO-Para is a controlled benchmark for evaluating the paraphrase robustness of Vision-Language-Action (VLA) models.

How to run

ltb · libero-para
$ npm i -g lettokenburn-cli
$ ltb bench info libero-para

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

0 sourced entries

No sourced scores recorded yet.

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

LIBERO-Para: A Diagnostic Benchmark and Metrics for Paraphrase Robustness in VLA Models

LIBERO-Para is a controlled benchmark for evaluating the paraphrase robustness of Vision-Language-Action (VLA) models. It independently varies action expressions and object references—the two core linguistic components of robotic manipulation instructions—enabling fine-grained analysis of how different types of linguistic variation affect VLA performance. 📄 Paper: arXiv:2603.28301 💻 Code:…