Verified100%Harbor adapterKnowledge & ReasoningSafety & AlignmentMultimodal

TruthfulQA

Truthful QA

TruthfulQA: 817个易错/误导性问题

How to run

ltb · truthfulqa
$ npm i -g lettokenburn-cli
$ ltb bench pull truthfulqa --n 50
$ ltb bench run ./truthfulqa -a claude-code -m anthropic/claude-opus-4-8
$ ltb bench push

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

4 sourced entries
HarnessSourceConfidenceLink
GPT-2 1.5B22.0N/AIndependentmediumSep 8, 2021arxiv.org
OPT-175B21.0N/AIndependentmediumNov 16, 2022arxiv.org
GPT-3-175B21.0N/AIndependentmediumSep 8, 2021arxiv.org
GPT-J-6B20.0N/AIndependentmediumSep 8, 2021arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

TruthfulQA (Truthful QA) — 817个易错/误导性问题. Scoring: 人类评判/LLM Judge. Difficulty: 中. Imported from benchmark_research.md (2026-06).