DuReader
DuReader is a large-scale open-domain Chinese machine reading comprehension dataset.
How to run
$ npm i -g lettokenburn-cli$ ltb bench info dureader
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
Scores
2 sourced entries| Harness | Source | Confidence | Link | |||
|---|---|---|---|---|---|---|
| ERNIE 2.0 Large | 64.2 | N/A | Independent | medium | Jul 29, 2019 | arxiv.org |
| ERNIE 2.0 Base | 61.3 | N/A | Independent | medium | Jul 29, 2019 | arxiv.org |
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
Reproduced by the community
All runsAbout
DuReader is a large-scale open-domain Chinese machine reading comprehension dataset. The dataset consists of 200K questions, 420K answers and 1M documents. The questions and documents are based on Baidu Search and Baidu Zhidao. The answers are manually generated. The dataset additionally provides question type annotations – each question was manually annotated as either Entity, Description or YesNo and one of Fact or Opinion.
Source: https://arxiv.org/pdf/1711.05073v4.pdf Image Source: https://arxiv.org/pdf/1711.05073v4.pdf