LetTokenBurnSoftware evolution itineraries (as Milestone DAGs) extracted from real-world repositories for AI agent evaluation.
$ npm i -g lettokenburn-cli$ ltb bench info swe-milestone
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
No sourced scores recorded yet.
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
Software evolution itineraries (as Milestone DAGs) extracted from real-world repositories for AI agent evaluation. Used by SWE-Milestone. [Paper] This dataset contains the metadata, task specifications (SRS documents), dependency graphs, and test classifications (e.g., fail_to_pass, pass_to_pass) needed to run SWE-Milestone evaluation trials.
Dataset Statistics
SWE-Milestone covers 7 real-world open-source repositories spanning 5 programming languages…