Verified71%Harbor: pendingCodingAgentic / Tool Use

CORE-Bench

Evaluate how well an LLM Agent is at computationally reproducing the results of a set of scientific papers.

How to run

ltb · core-bench
$ npm i -g lettokenburn-cli
$ ltb bench pull core-bench

External harness. pip install inspect-evals && inspect eval inspect_evals/core_bench --model <provider/model> https://github.com/UKGovernmentBEIS/inspect_evals

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

0 sourced entries

No sourced scores recorded yet.

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

Evaluate how well an LLM Agent is at computationally reproducing the results of a set of scientific papers.