Auto43%Harbor: pendingKnowledge & Reasoning

HealthBench

Evaluating Large Language Models Towards Improved Human Health

A comprehensive evaluation benchmark designed to assess language models' medical capabilities across a wide range of healthcare scenarios.

How to run

ltb · healthbench
$ npm i -g lettokenburn-cli
$ ltb bench pull healthbench

External harness. pip install inspect-evals && inspect eval inspect_evals/healthbench --model <provider/model> (other tasks: healthbench_hard, healthbench_consensus, healthbench_meta_eval) https://github.com/UKGovernmentBEIS/inspect_evals

License is link-only: ltb bench pull fetches rows from the original host for local evaluation only and does not write a solution/ directory. Do not redistribute the generated tasks.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

0 sourced entries

No sourced scores recorded yet.

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

A comprehensive evaluation benchmark designed to assess language models' medical capabilities across a wide range of healthcare scenarios.