Auto57%Harbor: pendingSafety & AlignmentAgentic / Tool Use

APEX-Harm

APEX-Harm: Evaluating Agent Safety in Shared Professional Workspaces

A benchmark evaluating prompt and script injection safety for long-horizon agents in shared professional workspaces across finance, consulting, and legal tasks.

How to run

ltb · apex-harm
$ npm i -g lettokenburn-cli
$ ltb bench info apex-harm

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

10 sourced entries
HarnessSourceConfidenceLink
Claude Sonnet 50.0N/AIndependentmediumOct 9, 2026arxiv.org
GPT-6 Astra0.0N/AIndependentmediumOct 9, 2026arxiv.org
Claude Opus 56.5N/AIndependentmediumOct 9, 2026arxiv.org
GPT-5.6 Luna11.5N/AIndependentmediumOct 9, 2026arxiv.org
Gemini 3.8 Flash11.8N/AIndependentmediumOct 9, 2026arxiv.org
GPT-5.6 Sol20.0N/AIndependentmediumOct 9, 2026arxiv.org
GPT-5.6-terra35.0N/AIndependentmediumOct 9, 2026arxiv.org
Gemini 3.6 Flash40.0N/AIndependentmediumOct 9, 2026arxiv.org
DeepSeek V4 Flash47.3N/AIndependentmediumOct 9, 2026arxiv.org
GLM-5.3 Flash71.8N/AIndependentmediumOct 9, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

APEX-Harm comprises 180 attack instances derived from 15 professional tasks in investment banking, law, and consulting. It features large workspaces with 115-328 files and various tools exposed via MCP servers.

The benchmark measures attack success, prompt exposure, and task performance across six attack categories. Results indicate that while some models achieve high task scores, they remain vulnerable to specific script replacement and generic script attacks.