Auto57%Harbor: pendingMultimodal

CC3M-TagMask

The dataset offers tag and mask annotations for image-text pairs from the CC3M validation set.

How to run

ltb · cc3m-tagmask
$ npm i -g lettokenburn-cli
$ ltb bench info cc3m-tagmask

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

3 sourced entries
HarnessSourceConfidenceLink
Qwen-72B69.3N/AIndependentmediumSep 28, 2023arxiv.org
Vicuna-33B52.7N/AIndependentmediumN/Apaperswithcode.com
Vicuna-7B44.1N/AIndependentmediumN/Apaperswithcode.com

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

The dataset offers tag and mask annotations for image-text pairs from the CC3M validation set. Tag annotations denote words that aptly describe the relationship between the image and the corresponding text. These annotations provide valuable insights into the semantic connection between each pair's visual and textual elements.