Auto86%Harbor: pendingAgentic / Tool UseKnowledge & Reasoning

Autonomous Science Bench

Autonomous Science Bench: Evaluating AI Agents for Autonomous Scientific Discovery

Evaluates AI agents on six budgeted design-build-test-learn campaigns in biology, chemistry, and materials science using discovery and learning gates.

How to run

ltb · autonomous-science-bench
$ npm i -g lettokenburn-cli
$ ltb bench info autonomous-science-bench

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

8 sourced entries
HarnessSourceConfidenceLink
Claude Opus 5.567.0N/AIndependentmediumOct 13, 2026arxiv.org
GPT-5.6-terra61.1N/AIndependentmediumOct 13, 2026arxiv.org
GPT-5.6 Luna27.8N/AIndependentmediumOct 13, 2026arxiv.org
Claude Sonnet 5.511.1N/AIndependentmediumOct 13, 2026arxiv.org
GLM-5.3 Flash11.1N/AIndependentmediumOct 13, 2026arxiv.org
MiniMax-M35.6N/AIndependentmediumOct 13, 2026arxiv.org
Qwen3.8 27B5.6N/AIndependentmediumOct 13, 2026arxiv.org
Claude Haiku 4.50.0N/AIndependentmediumOct 13, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

The benchmark comprises six campaigns grounded in published experiments across biology, chemistry, and materials science. Agents iteratively select experimental designs under a fixed budget via a stateful lab service.

Success requires passing two calibrated gates: a discovery gate evaluating measured designs and a learning gate evaluating the agent's predictive model. In pilot tests, the best configuration succeeded in 67% of trials.