Auto57%Harbor: pendingCodingAgentic / Tool Use

SWE-TaskFlow

SWE-TaskFlow: SWE-Bench Pro Interactive Task Flows This is the unified data release for “Coding-Agent Benchmarks Should Match Their Users’ Task Flows” by Igor Slinko, Yaroslav Golubev, and Sergey Titov.

How to run

ltb · swe-taskflow
$ npm i -g lettokenburn-cli
$ ltb bench info swe-taskflow

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

0 sourced entries

No sourced scores recorded yet.

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

SWE-TaskFlow: SWE-Bench Pro Interactive Task Flows

This is the unified data release for “Coding-Agent Benchmarks Should Match Their Users’ Task Flows” by Igor Slinko, Yaroslav Golubev, and Sergey Titov. Code: JetBrains-Research/SWE-TaskFlow-Generation-Public — dataset generation and QA validation tooling, the exact generation and agent prompts, and worked examples of how issues become task flows. Agent trajectories: JetBrains-Research/SWE-TaskFlow-SWE-Bench-Pro-Trajectories —…