Auto86%Harbor: pendingAgentic / Tool UseKnowledge & ReasoningMultimodal

DrugTargetWorld

DrugTargetWorld: A Synthetic Biobank for Training and Benchmarking AI Scientists

A synthetic biobank benchmark evaluating AI agents on end-to-end drug target discovery across 540 episodes with known causal ground truth.

How to run

ltb · drugtargetworld
$ npm i -g lettokenburn-cli
$ ltb bench info drugtargetworld

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

8 sourced entries
HarnessSourceConfidenceLink
Claude Sonnet 521.3N/AIndependentmediumOct 7, 2026arxiv.org
GPT-5.6 Sol15.8N/AIndependentmediumOct 7, 2026arxiv.org
Claude Opus 514.8N/AIndependentmediumOct 7, 2026arxiv.org
Claude Haiku 4.512.9N/AIndependentmediumOct 7, 2026arxiv.org
gpt-oss-20b7.4N/AIndependentmediumOct 7, 2026arxiv.org
GLM-4-32B4.8N/AIndependentmediumOct 7, 2026arxiv.org
Qwen3 8B4.6N/AIndependentmediumOct 7, 2026arxiv.org
Devstral Small3.3N/AIndependentmediumOct 7, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

Procedurally generates simulated biobanks with genotypes, proteins, health records, and MRI data for 54,000 participants. Each world has a hidden causal model specifying disease drivers and biases.

Agents are scored on a 100-point composite metric covering target identification, causal confidence, and intervention direction. Top agents scored ~40/100, struggling to distinguish causal from non-causal proteins.