Auto86%Harbor: pendingAgentic / Tool UseInstruction Following

PersonaCUABench

PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas

Evaluates computer-use agents on 74 tasks across 11 domains with 44 diverse personas to measure task completion and user satisfaction beyond fixed specifications.

How to run

ltb · personacuabench
$ npm i -g lettokenburn-cli
$ ltb bench info personacuabench

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

9 sourced entries
HarnessSourceConfidenceLink
Claude Opus 5.518.6N/AIndependentmediumOct 16, 2026arxiv.org
GPT-6 Astra17.8N/AIndependentmediumOct 16, 2026arxiv.org
MiniMax-M316.1N/AIndependentmediumOct 16, 2026arxiv.org
Muse Glimmer 30B15.0N/AIndependentmediumOct 16, 2026arxiv.org
Qwen3.8 27B15.0N/AIndependentmediumOct 16, 2026arxiv.org
Kimi K314.5N/AIndependentmediumOct 16, 2026arxiv.org
DeepSeek V4.1 Flash14.1N/AIndependentmediumOct 16, 2026arxiv.org
Grok-4.613.8N/AIndependentmediumOct 16, 2026arxiv.org
Gemini 3.8 Flash13.5N/AIndependentmediumOct 16, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

PersonaCUABench comprises 74 tasks in 11 domains, evaluated against 44 personas grouped into four types. A persona agent rewrites instructions and answers queries, isolating the effect of user identity on agent performance.

Scoring includes task completion against original requirements and user satisfaction ratings. Results show a 36% drop in completion relative to original requests, highlighting gaps between task solving and serving user constraints.