Artificial Intelligence-Generated Scientific Literature: A Critical Appraisal.

Autor:	Zybaczynska J; Section of Allergy, Asthma & Immunology, Department of Medicine, Pennsylvania State University College of Medicine, Hershey, Pa., Norris M; Section of Allergy, Asthma & Immunology, Department of Medicine, Pennsylvania State University College of Medicine, Hershey, Pa., Modi S; Section of Allergy, Asthma & Immunology, Department of Medicine, Pennsylvania State University College of Medicine, Hershey, Pa., Brennan J; Section of Allergy, Asthma & Immunology, Department of Medicine, Pennsylvania State University College of Medicine, Hershey, Pa., Jhaveri P; Division of Allergy & Immunology, Department of Pediatrics, Pennsylvania State University College of Medicine, Hershey, Pa., Craig TJ; Section of Allergy, Asthma & Immunology, Department of Medicine, Pennsylvania State University College of Medicine, Hershey, Pa., Al-Shaikhly T; Section of Allergy, Asthma & Immunology, Department of Medicine, Pennsylvania State University College of Medicine, Hershey, Pa. Electronic address: talshaikhly@pennstatehealth.psu.edu.
Jazyk:	angličtina
Zdroj:	The journal of allergy and clinical immunology. In practice [J Allergy Clin Immunol Pract] 2024 Jan; Vol. 12 (1), pp. 106-110. Date of Electronic Publication: 2023 Oct 12.
DOI:	10.1016/j.jaip.2023.10.010
Abstrakt:	Background: Review articles play a critical role in informing medical decisions and identifying avenues for future research. With the introduction of artificial intelligence (AI), there has been a growing interest in the potential of this technology to transform the synthesis of medical literature. Open AI's Generative Pre-trained Transformer (GPT-4) (Open AI Inc, San Francisco, CA) tool provides access to advanced AI that is able to quickly produce medical literature following only simple prompts. The accuracy of the generated articles requires review, especially in subspecialty fields like Allergy/Immunology. Objective: To critically appraise AI-synthesized allergy-focused minireviews. Methods: We tasked the GPT-4 Chatbot with generating 2 1,000-word reviews on the topics of hereditary angioedema and eosinophilic esophagitis. Authors critically appraised these articles using the Joanna Briggs Institute (JBI) tool for text and opinion and additionally evaluated domains of interest such as language, reference quality, and accuracy of the content. Results: The language of the AI-generated minireviews was carefully articulated and logically focused on the topic of interest; however, reviewers of the AI-generated articles indicated that the AI-generated content lacked depth, did not appear to be the result of an analytical process, missed critical information, and contained inaccurate information. Despite being provided instruction to utilize scientific references, the AI chatbot relied mainly on freely available resources, and the AI chatbot fabricated references. Conclusions: The AI holds the potential to change the landscape of synthesizing medical literature; however, apparent inaccurate and fabricated information calls for rigorous evaluation and validation of AI tools in generating medical literature, especially on subjects associated with limited resources. (Copyright © 2023 American Academy of Allergy, Asthma & Immunology. Published by Elsevier Inc. All rights reserved.)
Databáze:	MEDLINE
Externí odkaz:	Zobrazit plný text záznamu