VaccineStance
A human-annotated benchmark for vaccine stance detection constructed from social media posts collected between 2013 and 2022.
How to run
$ npm i -g lettokenburn-cli$ ltb bench info vaccinestance
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
Scores
5 sourced entriesEvery number links to where it was published. Low-confidence rows are muted and need per-cell verification.
Reproduced by the community
All runsAbout
VaccineStance consists of human-annotated social media posts related to vaccines, categorized into In-Favor, Against, or Neutral stances. It was constructed from data collected between 2013 and 2022.
The benchmark is evaluated using Macro-F1 score. Experiments show that the proposed MoPrO-SD framework improves upon human-written base prompts across various LLMs and settings.