LetTokenBurnSWE-Together SWE-Together: Evaluating Coding Agents in Interactive User Sessions.
$ npm i -g lettokenburn-cli$ ltb bench info swe-together
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
No sourced scores recorded yet.
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
SWE-Together
SWE-Together: Evaluating Coding Agents in Interactive User Sessions. SWE-Together reconstructs the multi-turn loop from real user–agent coding sessions, replaying each with a reactive user simulator that asks questions, adds requirements, and pushes back — preserving the original user's intent. This dataset holds the 109 discriminating tasks of the canonical suite as one metadata row per task.
📄 Paper: https://huggingface.co/papers/2606.29957 🌐 Website:…