The use of ChatGPT and Google Gemini in responding to orthognathic surgery-related questions: A comparative study.

Autor: Aziz AAA; Department of Orthodontics, Faculty of Dentistry, Assiut University, Assiut, Egypt., Abdelrahman HH; Department of Pediatric Dentistry and Dental Public Health, Faculty of Dentistry, Alexandria University, Alexandria, Egypt., Hassan MG; Department of Orthodontics, Faculty of Dentistry, Assiut University, Assiut, Egypt; Division of Bone and Mineral Diseases, Department of Medicine, School of Medicine, Washington University in St. Louis, St. Louis, Missouri. Electronic address: hmohamed@wustl.edu.
Jazyk: angličtina
Zdroj: Journal of the World federation of orthodontists [J World Fed Orthod] 2024 Oct 25. Date of Electronic Publication: 2024 Oct 25.
DOI: 10.1016/j.ejwf.2024.09.004
Abstrakt: Aim: This study employed a quantitative approach to compare the reliability of responses provided by ChatGPT-3.5, ChatGPT-4, and Google Gemini in response to orthognathic surgery-related questions.
Material and Methods: The authors adapted a set of 64 questions encompassing all of the domains and aspects related to orthognathic surgery. One author submitted the questions to ChatGPT3.5, ChatGPT4, and Google Gemini. The AI-generated responses from the three platforms were recorded and evaluated by 2 blinded and independent experts. The reliability of AI-generated responses was evaluated using a tool for accuracy of information and completeness. In addition, the provision of definitive answers to close-ended questions, references, graphical elements, and advice to schedule consultations with a specialist were collected.
Results: Although ChatGPT-3.5 achieved the highest information reliability score, the 3 LLMs showed similar reliability scores in providing responses to orthognathic surgery-related inquiries. Moreover, Google Gemini significantly included physician recommendations and provided graphical elements. Both ChatGPT-3.5 and -4 lacked these features.
Conclusion: This study shows that ChatGPT-3.5, ChatGPT-4, and Google Gemini can provide reliable responses to inquires about orthognathic surgery. However, Google Gemini stood out by incorporating additional references and illustrations within its responses. These findings highlight the need for an additional evaluation of AI capabilities across different healthcare domains.
(Copyright © 2024. Published by Elsevier Inc.)
Databáze: MEDLINE
Externí odkaz: