Auto43%Harbor: pendingKnowledge & Reasoning

SimpleQuestionsWikiData

SimpleQuestionsWikidata maps SimpleQuestions to Wikidata.

How to run

ltb · simplequestionswikidata
$ npm i -g lettokenburn-cli
$ ltb bench info simplequestionswikidata

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

1 sourced entry
HarnessSourceConfidenceLink
Falcon 2.036.3N/AIndependentmediumDec 24, 2019arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

SimpleQuestionsWikidata maps SimpleQuestions to Wikidata.

It was proposed in the paper Question Answering Benchmarks for Wikidata by Diefenbach et al.