medqa

From "What Disease Does This Patient Have? A Large-Scale Open Domain Question Answering Dataset from Medical Exams" (Jin et al.), MedQA is an open domain question answering dataset composed of questions from professional medical board exams.

From Jin et al., "to comply with fair use of law ,we shuffle the order of answer options and randomly delete one of the wrong options for each question for USMLE and MCMLE datasets, which results in four options with one right option and three wrong options". We use the 4-options, English subset ("US") of the dataset, which contains 12,723 questions.

The following is an example from the dataset:

{ "question": "A 23-year-old pregnant woman at 22 weeks gestation presents with burning upon urination. She states it started 1 day ago and has been worsening despite drinking more water and taking cranberry extract. She otherwise feels well and is followed by a doctor for her pregnancy. Her temperature is 97.7°F (36.5°C), blood pressure is 122/77 mmHg, pulse is 80/min, respirations are 19/min, and oxygen saturation is 98% on room air. Physical exam is notable for an absence of costovertebral angle tenderness and a gravid uterus. Which of the following is the best treatment for this patient?", "answer": "Nitrofurantoin", "options": { "A": "Ampicillin", "B": "Ceftriaxone", "C": "Ciprofloxacin", "D": "Doxycycline", "E": "Nitrofurantoin" }, "meta_info": "step2&3", "answer_idx": "E" }

Paper: https://arxiv.org/abs/2009.13081 Code: https://github.com/jind11/MedQA

@article{jin2020disease, title={What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams}, author={Jin, Di and Pan, Eileen and Oufattole, Nassim and Weng, Wei-Hung and Fang, Hanyi and Szolovits, Peter}, journal={arXiv preprint arXiv:2009.13081}, year={2020} }