ChatGPT in head and neck scientific writing: A precautionary anecdote.

Autor: Wu RT; Department of Plastic and Reconstruction Surgery, Chang Gung Memorial Hospital, Linkou, Taiwan; Division of Plastic and Reconstructive Surgery, Department of Surgery, Stanford University Hospital, Stanford, CA, USA., Dang RR; Department of Plastic and Reconstruction Surgery, Chang Gung Memorial Hospital, Linkou, Taiwan; Former fellow, Maxillofacial Oncology and Reconstructive Surgery, Department of Oral and Maxillofacial Surgery, Boston Medical Center, Boston, MA, USA. Electronic address: rushilrd@bu.edu.
Jazyk: angličtina
Zdroj: American journal of otolaryngology [Am J Otolaryngol] 2023 Nov-Dec; Vol. 44 (6), pp. 103980. Date of Electronic Publication: 2023 Jul 06.
DOI: 10.1016/j.amjoto.2023.103980
Abstrakt: Purpose: To evaluate the accuracy of ChatGPT references in scientific writing relevant to head and neck surgery.
Materials and Methods: Five commonly researched keywords relevant to head and neck surgery were selected (osteoradionecrosis of the jaws, oral cancer, adjuvant therapy for oral cancer, TORS, and free flap reconstruction in oral cancer). The AI chatbot was then asked to provide ten complete citations for each of the keywords. Two independent authors reviewed the results for accuracy and assigned each article a numerical score based on pre-selected criteria.
Results: Among 50 total references provided by ChatGPT, only five (10 %) were found to have the correct title, journal, authors, year of publication, and DOI. Merely 14 % of the presented references had correct DOI. References regarding free flap reconstruction for oral cancer were the least accurate from all the five categories, with no correct DOI. Complete inter-rater agreement was noted while evaluating the citations.
Conclusion: Only 10 % of the articles provided by ChatGPT, relevant to head and neck surgery, were correct. A high degree of academic hallucination was noted.
Competing Interests: Declaration of competing interest The authors have no conflict of interest to declare.
(Copyright © 2023 Elsevier Inc. All rights reserved.)
Databáze: MEDLINE
Externí odkaz: