Evaluating the validity of the nursing statements algorithmically generated based on the International Classifications of Nursing Practice for respiratory nursing care using large language models.

Autor:	Kim, Hyeoneui^1,2,3 (AUTHOR) ifilgood@snu.ac.kr, Park, Hyewon^1,4 (AUTHOR), Kang, Sunghoon⁵ (AUTHOR), Kim, Jinsol^1,3 (AUTHOR), Kim, Jeongha^1,6 (AUTHOR), Jung, Jinsun^1,3 (AUTHOR), Taira, Ricky⁷ (AUTHOR)
Předmět:	*Nursing literature Language models International Classification for Nursing Practice Generative pre-trained transformers Respiratory therapists
Zdroj:	Journal of the American Medical Informatics Association. Jun2024, Vol. 31 Issue 6, p1397-1403. 7p.
Abstrakt:	Objective This study aims to facilitate the creation of quality standardized nursing statements in South Korea's hospitals using algorithmic generation based on the International Classifications of Nursing Practice (ICNP) and evaluation through Large Language Models. Materials and Methods We algorithmically generated 15 972 statements related to acute respiratory care using 117 concepts and concept composition models of ICNP. Human reviewers, Generative Pre-trained Transformers 4.0 (GPT-4.0), and Bio_Clinical Bidirectional Encoder Representations from Transformers (BERT) evaluated the generated statements for validity. The evaluation by GPT-4.0 and Bio_ClinicalBERT was conducted with and without contextual information and training. Results Of the generated statements, 2207 were deemed valid by expert reviewers. GPT-4.0 showed a zero-shot AUC of 0.857, which aggravated with contextual information. Bio_ClinicalBERT, after training, significantly improved, reaching an AUC of 0.998. Conclusion Bio_ClinicalBERT effectively validates auto-generated nursing statements, offering a promising solution to enhance and streamline healthcare documentation processes. [ABSTRACT FROM AUTHOR]
Databáze:	Library, Information Science & Technology Abstracts
Externí odkaz:	Zobrazit plný text záznamu