Auto86%Harbor: pendingMultimodal

R2RI

Robot-to-Robot Interaction (R2RI)

A large-scale synthetic multimodal dataset with >6.5M frames and ~5000 videos for evaluating robot-robot interaction perception tasks.

How to run

ltb · r2ri
$ npm i -g lettokenburn-cli
$ ltb bench info r2ri

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

7 sourced entries
HarnessSourceConfidenceLink
DINO55.4N/AIndependentmediumOct 5, 2026arxiv.org
RT-DETR44.8N/AIndependentmediumOct 5, 2026arxiv.org
Faster R-CNN29.6N/AIndependentmediumOct 5, 2026arxiv.org
Def. DETR24.8N/AIndependentmediumOct 5, 2026arxiv.org
YOLO11l21.2N/AIndependentmediumOct 5, 2026arxiv.org
YOLO26l20.1N/AIndependentmediumOct 5, 2026arxiv.org
DETR19.1N/AIndependentmediumOct 5, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

R2RI is a synthetic dataset featuring humanoid robots in realistic social interactions, captured from egocentric and exocentric views using synchronized RGB and event cameras. It supports eight perception tasks including detection, pose estimation, and action recognition.

The benchmark evaluates state-of-the-art models across RGB and event modalities, providing baseline performance metrics to analyze modality-specific strengths and trade-offs in robot interaction scenarios.