Harnessing the Power of Generative AI for Clinical Summaries: Perspectives From Emergency Physicians.

Autor: Barak-Corren Y; Predictive Medicine Group, Computational Health Informatics Program, Boston Children's Hospital, Boston, MA; Division of Cardiology, Children's Hospital of Philadelphia, Philadelphia, PA. Electronic address: yuval.barakcorren@childrens.harvard.edu., Wolf R; Emergency Medicine Boston Children's Hospital, Boston, MA., Rozenblum R; Harvard Medical School Boston, MA; Division of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA., Creedon JK; Emergency Medicine Boston Children's Hospital, Boston, MA; Harvard Medical School Boston, MA., Lipsett SC; Emergency Medicine Boston Children's Hospital, Boston, MA; Harvard Medical School Boston, MA., Lyons TW; Emergency Medicine Boston Children's Hospital, Boston, MA; Harvard Medical School Boston, MA., Michelson KA; Ann and Robert Lurie Children's Hospital of Chicago, Chicago, IL., Miller KA; Emergency Medicine Boston Children's Hospital, Boston, MA; Harvard Medical School Boston, MA., Shapiro DJ; Division of Pediatric Emergency Medicine, University of California, San Francisco, San Francisco, CA., Reis BY; Predictive Medicine Group, Computational Health Informatics Program, Boston Children's Hospital, Boston, MA; Harvard Medical School Boston, MA., Fine AM; Emergency Medicine Boston Children's Hospital, Boston, MA; Harvard Medical School Boston, MA.
Jazyk: angličtina
Zdroj: Annals of emergency medicine [Ann Emerg Med] 2024 Aug; Vol. 84 (2), pp. 128-138. Date of Electronic Publication: 2024 Mar 12.
DOI: 10.1016/j.annemergmed.2024.01.039
Abstrakt: Study Objective: The workload of clinical documentation contributes to health care costs and professional burnout. The advent of generative artificial intelligence language models presents a promising solution. The perspective of clinicians may contribute to effective and responsible implementation of such tools. This study sought to evaluate 3 uses for generative artificial intelligence for clinical documentation in pediatric emergency medicine, measuring time savings, effort reduction, and physician attitudes and identifying potential risks and barriers.
Methods: This mixed-methods study was performed with 10 pediatric emergency medicine attending physicians from a single pediatric emergency department. Participants were asked to write a supervisory note for 4 clinical scenarios, with varying levels of complexity, twice without any assistance and twice with the assistance of ChatGPT Version 4.0. Participants evaluated 2 additional ChatGPT-generated clinical summaries: a structured handoff and a visit summary for a family written at an 8th grade reading level. Finally, a semistructured interview was performed to assess physicians' perspective on the use of ChatGPT in pediatric emergency medicine. Main outcomes and measures included between subjects' comparisons of the effort and time taken to complete the supervisory note with and without ChatGPT assistance. Effort was measured using a self-reported Likert scale of 0 to 10. Physicians' scoring of and attitude toward the ChatGPT-generated summaries were measured using a 0 to 10 Likert scale and open-ended questions. Summaries were scored for completeness, accuracy, efficiency, readability, and overall satisfaction. A thematic analysis was performed to analyze the content of the open-ended questions and to identify key themes.
Results: ChatGPT yielded a 40% reduction in time and a 33% decrease in effort for supervisory notes in intricate cases, with no discernible effect on simpler notes. ChatGPT-generated summaries for structured handoffs and family letters were highly rated, ranging from 7.0 to 9.0 out of 10, and most participants favored their inclusion in clinical practice. However, there were several critical reservations, out of which a set of general recommendations for applying ChatGPT to clinical summaries was formulated.
Conclusion: Pediatric emergency medicine attendings in our study perceived that ChatGPT can deliver high-quality summaries while saving time and effort in many scenarios, but not all.
(Copyright © 2024 American College of Emergency Physicians. Published by Elsevier Inc. All rights reserved.)
Databáze: MEDLINE
Externí odkaz: