ChatGPT to generate clinical vignettes for teaching and multiple-choice questions for assessment: A randomized controlled experiment.

Autor:	Coşkun Ö; Department of Medical Education and Informatics, Gazi University, Ankara, Turkey., Kıyak YS; Department of Medical Education and Informatics, Gazi University, Ankara, Turkey., Budakoğlu Iİ; Department of Medical Education and Informatics, Gazi University, Ankara, Turkey.
Jazyk:	angličtina
Zdroj:	Medical teacher [Med Teach] 2024 Mar 13, pp. 1-7. Date of Electronic Publication: 2024 Mar 13.
DOI:	10.1080/0142159X.2024.2327477
Abstrakt:	Aim: This study aimed to evaluate the real-life performance of clinical vignettes and multiple-choice questions generated by using ChatGPT. Methods: This was a randomized controlled study in an evidence-based medicine training program. We randomly assigned seventy-four medical students to two groups. The ChatGPT group received ill-defined cases generated by ChatGPT, while the control group received human-written cases. At the end of the training, they evaluated the cases by rating 10 statements using a Likert scale. They also answered 15 multiple-choice questions (MCQs) generated by ChatGPT. The case evaluations of the two groups were compared. Some psychometric characteristics (item difficulty and point-biserial correlations) of the test were also reported. Results: None of the scores in 10 statements regarding the cases showed a significant difference between the ChatGPT group and the control group ( p > .05). In the test, only six MCQs had acceptable levels (higher than 0.30) of point-biserial correlation, and five items could be considered acceptable in classroom settings. Conclusions: The results showed that the quality of the vignettes are comparable to those created by human authors, and some multiple-questions have acceptable psychometric characteristics. ChatGPT has potential in generating clinical vignettes for teaching and MCQs for assessment in medical education.
Databáze:	MEDLINE
Externí odkaz:	Zobrazit plný text záznamu