Assessing the performance of chat generative pretrained transformer (ChatGPT) in answering chronic kidney disease-related questions.

Autor: Can B; Internal Medicine Department, Basaksehir Cam and Sakura City Hospital, Istanbul, Turkey., Kahvecioğlu ED; Internal Medicine Department, Basaksehir Cam and Sakura City Hospital, Istanbul, Turkey., Palıt F; Nephrology Department, Basaksehir Cam and Sakura City Hospital, Istanbul, Turkey., Cebeci E; Nephrology Department, Haseki Training and Research Hospital, Istanbul, Turkey., Küçük M; Nephrology Department, Prof Dr Cemil Tascioglu City Hospital, Istanbul, Turkey., Karaali Z; Internal Medicine Department, Basaksehir Cam and Sakura City Hospital, Istanbul, Turkey.
Jazyk: angličtina
Zdroj: Therapeutic apheresis and dialysis : official peer-reviewed journal of the International Society for Apheresis, the Japanese Society for Apheresis, the Japanese Society for Dialysis Therapy [Ther Apher Dial] 2024 Dec 16. Date of Electronic Publication: 2024 Dec 16.
DOI: 10.1111/1744-9987.14239
Abstrakt: Background: Chatbots produced by artificial intelligence are frequently used in health information today. We aimed to investigate the reliability and reproducibility of the answers given by Chat Generative Pretrained Transformer (ChatGPT), one of the most used chatbots, to frequently asked questions related to chronic kidney failure.
Methods: We reviewed frequently asked questions related to chronic kidney disease (CKD) from social media platforms and Internet. The questions were asked to ChatGPT, and the answers were scored from 1 to 4 by two experienced nephrologists.
Results: Eighty-five frequently asked questions about chronic renal failure were examined and 60 of them were included in the study after exclusion criteria. Fifty-one (85%) of the questions received 1 point, 7 (11.7%) received 2 points and 2 (3.3%) received 3 points. The similarity rates of the answers to the repeated questions were between 80% and 100%.
Conclusion: ChatGPT has provided reliable responses with high reproducibility to inquiries related to CKD.
(© 2024 International Society for Apheresis and Japanese Society for Apheresis.)
Databáze: MEDLINE
Externí odkaz: