3DVerifierBench
Harbor adapterDVerifierBench Grounding Generative Verification in 3D ContentShuanglin Li, Jiaying Lin, Shuquan Ye.
- Samples
- 2,581
- Released
- 2026
- Scores
- 10
CineRecon: Benchmarking Frontier Models for Agentic Cinematic Reconstruction
A benchmark of 50 reference videos and 360 annotated clips evaluating agents' ability to reconstruct editable dynamic 3D scenes from video.
$ npm i -g lettokenburn-cli$ ltb bench info cinerecon
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
| Harness | Source | Confidence | Link | |||
|---|---|---|---|---|---|---|
| Claude Opus 5.5 | 76.5 | claude code 2.1.280 | Independent | medium | Oct 12, 2026 | arxiv.org |
| GPT-6 Astra | 67.6 | codex cli 0.153.4 | Independent | medium | Oct 12, 2026 | arxiv.org |
| Kimi K3 | 57.3 | kimi code cli 2.0.2 | Independent | medium | Oct 12, 2026 | arxiv.org |
| Grok-4.6 | 54.7 | grok build 1.0.41 | Independent | medium | Oct 12, 2026 | arxiv.org |
| DeepSeek V4.1 Flash | 53.9 | dsh 0.1.5-rc.3 | Independent | medium | Oct 12, 2026 | arxiv.org |
| GLM-5.3 Flash | 53.8 | zcode cli 0.16.9 | Independent | medium | Oct 12, 2026 | arxiv.org |
| Gemini 3.8 Flash | 52.8 | antigravity cli 1.2.11 | Independent | medium | Oct 12, 2026 | arxiv.org |
| Qwen3.8 Max | 49.8 | qwen code 0.24.1 | Independent | medium | Oct 12, 2026 | arxiv.org |
| Claude Opus 4.8 | 43.3 | claude code 2.1.278 | Independent | medium | Oct 12, 2026 | arxiv.org |
| Qwen3.8 Flash | 42.7 | qwen code 0.24.1 | Independent | medium | Oct 12, 2026 | arxiv.org |
| GPT-5.6 Sol | 39.7 | codex cli 0.153.4 | Independent | medium | Oct 12, 2026 | arxiv.org |
| Gemini 3.1 Pro | 22.5 | antigravity cli 1.2.11 | Independent | medium | Oct 12, 2026 | arxiv.org |
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
Comprises 50 videos from film, real-world footage, and games. Agents construct Blender scenes under Proxy, Simplified, or Detailed settings.
Scored by a vision-language judge across camera, static, and dynamic consistency. Evaluations reveal persistent failures in subject motion and interactions.