AgentPersonaBench
Harbor: pendingA benchmark of 2,460 tasks across 867 traits evaluating latent persona adherence via observable actions in survey, chat, web, and app environments.
- Samples
- 2,460
- Released
- 2026
- Scores
- 7
CREATE: Creativity Evaluation of VLMs using the Visual Remote Associates Test
Previous works of video captioning aim to objectively describe the video's actual content, which lacks subjective and attractive expression, limiting its practical application scenarios.
$ npm i -g lettokenburn-cli$ ltb bench info create
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
| Harness | Source | Confidence | Link | |||
|---|---|---|---|---|---|---|
| Qwen3.8 27B | 39.6 | N/A | Independent | medium | Oct 13, 2026 | arxiv.org |
| Gemma-4-12B-it | 37.8 | N/A | Independent | medium | Oct 13, 2026 | arxiv.org |
| qwen3.5-9B | 35.1 | N/A | Independent | medium | Oct 13, 2026 | arxiv.org |
| llama-4 Scout | 34.4 | N/A | Independent | medium | Oct 13, 2026 | arxiv.org |
| DeepSeek Flash | 34.2 | N/A | Independent | medium | Oct 13, 2026 | arxiv.org |
| InternVL3.5-8B-Instruct | 32.7 | N/A | Independent | medium | Oct 13, 2026 | arxiv.org |
| Claude Haiku 4.5 | 31.0 | N/A | Independent | medium | Oct 13, 2026 | arxiv.org |
| GPT-5.6 Luna | 28.2 | N/A | Independent | medium | Oct 13, 2026 | arxiv.org |
| GPT-5.6 Sol | 27.7 | N/A | Independent | medium | Oct 13, 2026 | arxiv.org |
| Molmo2-8B | 26.0 | N/A | Independent | medium | Oct 13, 2026 | arxiv.org |
| Claude Opus 5.5 | 24.9 | N/A | Independent | medium | Oct 13, 2026 | arxiv.org |
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
Previous works of video captioning aim to objectively describe the video's actual content, which lacks subjective and attractive expression, limiting its practical application scenarios. Video titling is intended to achieve this goal, but there is a lack of a proper benchmark. In this paper, we propose to CREATE, the first large-scale Chinese shoRt vidEo retrievAl and Title gEneration benchmark, to facilitate research and application in video titling and video retrieval in Chinese. CREATE consists of a high-quality labeled 210K dataset and two large-scale 3M/10M pre-training datasets, covering 51 categories, 50K+ tags, 537K manually annotated titles and captions, and 10M+ short videos. Based on CREATE, we propose a novel model ALWIG which combines video retrieval and video titling tasks to achieve the purpose of multi-modal ALignment WIth Generation with the help of video tags and a GPT pre-trained model. CREATE opens new directions for facilitating future research and applications on video titling and video retrieval in the field of Chinese short videos.