Auto86%Harbor: pendingSafety & AlignmentAgentic / Tool UseKnowledge & Reasoning

DRYLAB-Bench

DRYLAB-Bench: Benchmarking the Biosecurity Risk of Agentic LLM Mutation Design

Evaluates high-risk biological mutation design capabilities of LLM agents across 30 hazardous scenarios using empirical wet-lab data for safe verification.

How to run

ltb · drylab-bench
$ npm i -g lettokenburn-cli
$ ltb bench info drylab-bench

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

12 sourced entries
HarnessSourceConfidenceLink
Grok 4.50.5N/AIndependentmediumOct 9, 2026arxiv.org
Qwen3.8 Max0.4N/AIndependentmediumOct 9, 2026arxiv.org
DeepSeek V4 Flash0.4N/AIndependentmediumOct 9, 2026arxiv.org
Gemini 3.6 Flash0.4N/AIndependentmediumOct 9, 2026arxiv.org
Gemini 3.8 Flash0.4N/AIndependentmediumOct 9, 2026arxiv.org
GPT-5.6 Luna0.3N/AIndependentmediumOct 9, 2026arxiv.org
GPT-5.6 Sol0.3N/AIndependentmediumOct 9, 2026arxiv.org
GPT-5.6-terra0.2N/AIndependentmediumOct 9, 2026arxiv.org
GPT-6 Astra0.1N/AIndependentmediumOct 9, 2026arxiv.org
Claude Opus 4.80.1N/AIndependentmediumOct 9, 2026arxiv.org
Claude Opus 50.1N/AIndependentmediumOct 9, 2026arxiv.org
Claude Fable 50.0N/AIndependentmediumOct 9, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

DRYLAB-Bench tasks LLM agents with 30 genuinely hazardous mutation-design scenarios in a multi-round, tool-augmented environment. It leverages specialized biological design tools to iteratively refine candidate sequences.

Scoring uses the Biosecurity Risk Score (BRS), validated against 187,695 empirical measurements from ProteinGym and ViroGym. Results show frontier models pose substantial threats, with tool augmentation significantly amplifying risk.