Auto86%Harbor: pendingSafety & AlignmentAgentic / Tool Use

INFUSE

INFUSE: A Unified Surface Benchmark for Indirect Prompt Injection in Agentic Systems

An end-to-end benchmark with 40 tasks and 56 attack scenarios evaluating indirect prompt injection success across 19 LLMs in realistic agentic workflows.

How to run

ltb · infuse
$ npm i -g lettokenburn-cli
$ ltb bench info infuse

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

12 sourced entries
HarnessSourceConfidenceLink
GPT-5 nano (2025-08-07)8.4N/AIndependentmediumOct 14, 2026arxiv.org
Qwen3 4B10.4N/AIndependentmediumOct 14, 2026arxiv.org
GPT-5.412.6N/AIndependentmediumOct 14, 2026arxiv.org
Gemma 3 27B13.8N/AIndependentmediumOct 14, 2026arxiv.org
GPT-3.5 Turbo16.8N/AIndependentmediumOct 14, 2026arxiv.org
Gemma 3 12B IT18.7N/AIndependentmediumOct 14, 2026arxiv.org
Qwen2.5 14B Instruct20.9N/AIndependentmediumOct 14, 2026arxiv.org
Llama-3.1-8B-Instruct22.0N/AIndependentmediumOct 14, 2026arxiv.org
Qwen2.5 32B Instruct25.7N/AIndependentmediumOct 14, 2026arxiv.org
GPT-526.3N/AIndependentmediumOct 14, 2026arxiv.org
Llama-3.2 3B29.9N/AIndependentmediumOct 14, 2026arxiv.org
GPT-4o-mini33.8N/AIndependentmediumOct 14, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

INFUSE comprises 40 long-horizon tasks and 56 attack scenarios spanning five threat categories, injected via realistic surfaces like files and terminal output within Docker sandboxes. It evaluates 19 LLMs using heuristic verifiers and an LLM judge, reporting mean attack success rates of 19.6% and highlighting security-utility trade-offs.