Auto86%Harbor: pendingAgentic / Tool UseLong Context

DAYJOB

DAYJOB: A Benchmark for Long-Horizon Professional Work

A benchmark of 130 long-horizon professional tasks in healthcare and finance requiring agentic workflows within containerized environments.

How to run

ltb · dayjob
$ npm i -g lettokenburn-cli
$ ltb bench info dayjob

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

6 sourced entries
HarnessSourceConfidenceLink
Claude Opus 5.524.7N/AIndependentmediumOct 1, 2026arxiv.org
GPT-6 Astra11.6N/AIndependentmediumOct 1, 2026arxiv.org
Claude Fable 5.19.6N/AIndependentmediumOct 1, 2026arxiv.org
Claude Opus 58.4N/AIndependentmediumOct 1, 2026arxiv.org
Grok-4.78.4N/AIndependentmediumOct 1, 2026arxiv.org
Muse Spark 1.37.8N/AIndependentmediumOct 1, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

The DAYJOB benchmark consists of realistic requests paired with a workspace of files (PDFs, spreadsheets) and binary rubric criteria. Tasks are estimated to take professionals ~14-17 hours on average.

Scoring is based on an agentic judge verifying if all binary criteria in the task-specific rubric are met; attempts pass only if every criterion passes.