Model

StarCoder 15.5B

Vendor N/A

Coding

Benchmark	Score	Metric	Harness	Source	Confidence	Link
MBPP	52.7	accuracy	N/A	Independent	medium	arxiv.org
MBPP	47.2	accuracy	N/A	Independent	medium	arxiv.org
TACO-BAAI	11.6	easy_pass@1	N/A	Independent	medium	arxiv.org