AgentDojo
A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents
Assesses whether AI agents can be hijacked by malicious third parties using prompt injections in simple environments such as a workspace or travel booking app.
How to run
$ npm i -g lettokenburn-cli$ ltb bench pull agentdojo
External harness. pip install inspect-evals && inspect eval inspect_evals/agentdojo --model <provider/model> https://github.com/UKGovernmentBEIS/inspect_evals
License is link-only: ltb bench pull fetches rows from the original host for local evaluation only and does not write a solution/ directory. Do not redistribute the generated tasks.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
Scores
0 sourced entriesNo sourced scores recorded yet.
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
Reproduced by the community
All runsAbout
Assesses whether AI agents can be hijacked by malicious third parties using prompt injections in simple environments such as a workspace or travel booking app.