Incomplete14%Harbor nativeAgentic / Tool Use

erp-bench

ERP-Bench is the Odoo 19 benchmark used in the Anchor paper, "Preventing Artifact Drift in Agent Benchmark Generation." It contains 300 long-horizon procurement and manufacturing tasks generated from a single CP-SAT-backed specification.

How to run

ltb · erp-bench
$ npm i -g lettokenburn-cli
$ ltb bench run agentic-labs/erp-bench@1 --benchmark erp-bench -a claude-code -m anthropic/claude-opus-4-8
$ ltb bench push

Harbor-native: you can also call Harbor directly.

harbor
$ harbor run -d agentic-labs/erp-bench@1 -a claude-code -m anthropic/claude-opus-4-8

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

0 sourced entries

No sourced scores recorded yet.

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

agentic-labs/erp-bench