LongVideoBench
Harbor: pendingA challenging benchmark that examines large multimodal models on understanding up to one-hour long videos interleaved with text.
- Samples
- N/A
- Released
- 2024
- Scores
- 0
Dataset arXiv Website Code VSI-Bench VSI-Bench-Debiased v1 [!
$ npm i -g lettokenburn-cli$ ltb bench info vsi-bench
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
No sourced scores recorded yet.
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
Dataset arXiv Website Code
VSI-Bench
VSI-Bench-Debiased v1
[!IMPORTANT] [Aug. 9, 2026] PROVENANCE UPDATE: The existing "Debiased" subset is VSI-Bench-Debiased v1, a designer-in-the-loop manual pilot created with bespoke per-question-type filtering heuristics. It predates and was not generated by the automated Iterative Bias Pruning (IBP) algorithm. We retain v1 for reproducibility and will version any future automated subset separately.…