Incomplete0%Harbor: pendingKnowledge & Reasoning

FewCLUE

FewCLUE bustm — AI evaluation benchmark listed by opencompass.

How to run

ltb · fewclue
$ npm i -g lettokenburn-cli
$ ltb bench pull fewclue

External harness. pip install opencompass && opencompass --models <model_cfg> --datasets FewCLUE_bustm_gen (OpenCompass dataset config dir 'FewCLUE_bustm') https://github.com/open-compass/opencompass

License is link-only: ltb bench pull fetches rows from the original host for local evaluation only and does not write a solution/ directory. Do not redistribute the generated tasks.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

3 sourced entries
HarnessSourceConfidenceLink
GLM-130B73.8N/AIndependentmediumOct 5, 2022arxiv.org
ERNIE 3.0 Titan-260B64.4N/AIndependentmediumOct 5, 2022arxiv.org
ERNIE 3.0 Titan-260B53.8N/AIndependentmediumOct 5, 2022arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

FewCLUE bustm — AI evaluation benchmark listed by opencompass.