News QA
Harbor: pendingQuestion answering using news articles.
Verified71%Knowledge & Reasoning
- Samples
- N/A
- Released
- 2017
- Scores
- 8
News-Truthful
This the dataset for Every Language Counts: Learn and Unlearn in Multilingual LLMs.
How to run
ltb · news-truthful
$ npm i -g lettokenburn-cli$ ltb bench info news-truthful
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
Scores
0 sourced entriesNo sourced scores recorded yet.
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
Reproduced by the community
All runsLoading community runs…
About
This the dataset for Every Language Counts: Learn and Unlearn in Multilingual LLMs.
Each of the 100 row contains a GPT generated 'real' news article, a corresponding 'fake' news article with injected fake information, and the 'fake' keyword. It contains 10 Q&A pairs on 'real' news for instruction tunning. We also provide one question to evaluate 'real' news understanding and another question to count the appearance of 'fake' detail.