LetTokenBurn
Sign in
Auto86%Harbor adapterMultimodalKnowledge & Reasoning

Video-MME-v2

Videos re-encoded to H265, maintaining consistent evaluation scores.

PaperDataset

How to run

ltb · video-mme-v2
$ npm i -g lettokenburn-cli
$ ltb bench pull video-mme-v2 --n 50
$ ltb bench run ./video-mme-v2 -a claude-code -m anthropic/claude-opus-4-8
$ ltb bench push

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

0 sourced entries

No sourced scores recorded yet.

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

🔥 News

2026.06.11 Videos re-encoded to H265, maintaining consistent evaluation scores. Fixed 2 incorrect MP4s & 3 mismatched URLs. Original data preserved in the original branch.

2026.05.22 Task types are now available for Q1-Q3 in coherence (logic) groups.

🤗 About This Repo

This repository contains annotation data for "Video-MME-v2: Towards the Next Stage in Benchmarks for Comprehensive Video Understanding". It mainly consists of three…