MMMU
Massive Multi-discipline Multimodal
MMMU: 11.5K大学级图文题，30学科
How to run
ltb · mmmu
$ npm i -g lettokenburn-cli$ ltb bench pull mmmu
External harness. pip install lm-eval && lm_eval --model <hf|vllm|openai-chat-completions> --model_args <model args> --tasks mmmu_val_art (lm-evaluation-harness task family 'mmmu') https://github.com/EleutherAI/lm-evaluation-harness
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
Scores
0 sourced entriesNo sourced scores recorded yet.
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
Reproduced by the community
All runsLoading community runs…
About
MMMU (Massive Multi-discipline Multimodal) — 11.5K大学级图文题，30学科. Scoring: 准确率. Difficulty: 高. Imported from benchmark_research.md (2026-06).