OR-Bench
Harbor: pendingOR-Bench Hard-1K measures over-refusal in LLMs: the tendency to reject safe prompts that superficially resemble harmful ones.
Verified71%Safety & Alignment
- Samples
- 2,109
- Released
- 2024
- Scores
- 3
OR-Clarify
OR-Clarify 📄 Paper: Ask Before You Optimize: Dynamic Pre-Formulation Clarification for Interactive Optimization OR-Clarify is a benchmark for testing whether an agent asks the right questions before formulating an optimization model.
How to run
ltb · or-clarify
$ npm i -g lettokenburn-cli$ ltb bench info or-clarify
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
Scores
0 sourced entriesNo sourced scores recorded yet.
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
Reproduced by the community
All runsLoading community runs…
About
OR-Clarify
📄 Paper: Ask Before You Optimize: Dynamic Pre-Formulation Clarification for Interactive Optimization OR-Clarify is a benchmark for testing whether an agent asks the right questions before formulating an optimization model. Most optimization benchmarks give an agent a complete problem statement. OR-Clarify instead starts with an incomplete business brief. The agent must identify missing requirements that could change the optimization formulation, ask for the relevant…