Auto86%Harbor: pendingKnowledge & Reasoning

KQA Pro

A large-scale dataset for Complex KBQA.

How to run

ltb · kqa-pro
$ npm i -g lettokenburn-cli
$ ltb bench info kqa-pro

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

1 sourced entry
HarnessSourceConfidenceLink
ChatGPT47.9N/AIndependentmediumMar 14, 2023arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

A large-scale dataset for Complex KBQA.

Source: [KQA Pro: A Large-Scale Dataset with Interpretable Programs and Accurate SPARQLs for Complex Question Answering over Knowledge Base](/paper/kqa-pro-a-large-diagnostic-dataset-for)