Auto57%Harbor: pendingKnowledge & Reasoning

TimeQuestions

Question answering over knowledge graphs (KG-QA) is a vital topic in IR.

How to run

ltb · timequestions
$ npm i -g lettokenburn-cli
$ ltb bench info timequestions

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

3 sourced entries
HarnessSourceConfidenceLink
GPT-430.6N/AIndependentmediumSep 22, 2023arxiv.org
InstructGPT22.4N/AIndependentmediumMar 4, 2022arxiv.org
Llama317.8N/AIndependentmediumFeb 27, 2023arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

Question answering over knowledge graphs (KG-QA) is a vital topic in IR. Questions with temporal intent are a special class of practical importance, but have not received much attention in research. We present EXAQT, the first end-to-end system for answering complex temporal questions that have multiple entities and predicates, and associated temporal conditions.