Auto71%Harbor: pendingKnowledge & Reasoning

UniProtQA

UniProtQA consists of proteins and textual queries about their functions and properties.

How to run

ltb · uniprotqa
$ npm i -g lettokenburn-cli
$ ltb bench info uniprotqa

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

1 sourced entry
HarnessSourceConfidenceLink
LLaMA 2 7B0.0N/AIndependentmediumJul 18, 2023arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

UniProtQA consists of proteins and textual queries about their functions and properties. The dataset is constructed from UniProt, and consists 4 types of questions with regard to functions, official names, protein families, and sub-cellular locations. We collect a total of 569, 516 proteins and 1, 891, 506 question-answering samples.