Auto71%Harbor: pendingSafety & AlignmentMultimodal

VSI-Bench

Dataset arXiv Website Code VSI-Bench VSI-Bench-Debiased v1 [!

How to run

ltb · vsi-bench
$ npm i -g lettokenburn-cli
$ ltb bench info vsi-bench

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

0 sourced entries

No sourced scores recorded yet.

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

Dataset arXiv Website Code

VSI-Bench

VSI-Bench-Debiased v1

[!IMPORTANT] [Aug. 9, 2026] PROVENANCE UPDATE: The existing "Debiased" subset is VSI-Bench-Debiased v1, a designer-in-the-loop manual pilot created with bespoke per-question-type filtering heuristics. It predates and was not generated by the automated Iterative Bias Pruning (IBP) algorithm. We retain v1 for reproducibility and will version any future automated subset separately.…