AI-Assisted Decision-Making in Long-Term Care: Qualitative Study on Prerequisites for Responsible Innovation.

Autor:	Lukkien DRM; Vilans Centre of Expertise of Long Term Care, Utrecht, Netherlands.; Copernicus Institute of Sustainable Development, Utrecht University, Utrecht, Netherlands., Stolwijk NE; Vilans Centre of Expertise of Long Term Care, Utrecht, Netherlands., Ipakchian Askari S; Vilans Centre of Expertise of Long Term Care, Utrecht, Netherlands.; Human Technology Interaction, Eindhoven University of Technology, Eindhoven, Netherlands., Hofstede BM; Vilans Centre of Expertise of Long Term Care, Utrecht, Netherlands.; Human Technology Interaction, Eindhoven University of Technology, Eindhoven, Netherlands., Nap HH; Vilans Centre of Expertise of Long Term Care, Utrecht, Netherlands.; Human Technology Interaction, Eindhoven University of Technology, Eindhoven, Netherlands., Boon WPC; Copernicus Institute of Sustainable Development, Utrecht University, Utrecht, Netherlands., Peine A; Faculty of Humanities, Open University of The Netherlands, Heerlen, Netherlands., Moors EHM; Copernicus Institute of Sustainable Development, Utrecht University, Utrecht, Netherlands., Minkman MMN; Vilans Centre of Expertise of Long Term Care, Utrecht, Netherlands.; TIAS School for Business and Society, Tilburg University, Tilburg, Netherlands.
Jazyk:	angličtina
Zdroj:	JMIR nursing [JMIR Nurs] 2024 Jul 25; Vol. 7, pp. e55962. Date of Electronic Publication: 2024 Jul 25.
DOI:	10.2196/55962
Abstrakt:	Background: Although the use of artificial intelligence (AI)-based technologies, such as AI-based decision support systems (AI-DSSs), can help sustain and improve the quality and efficiency of care, their deployment creates ethical and social challenges. In recent years, a growing prevalence of high-level guidelines and frameworks for responsible AI innovation has been observed. However, few studies have specified the responsible embedding of AI-based technologies, such as AI-DSSs, in specific contexts, such as the nursing process in long-term care (LTC) for older adults. Objective: Prerequisites for responsible AI-assisted decision-making in nursing practice were explored from the perspectives of nurses and other professional stakeholders in LTC. Methods: Semistructured interviews were conducted with 24 care professionals in Dutch LTC, including nurses, care coordinators, data specialists, and care centralists. A total of 2 imaginary scenarios about AI-DSSs were developed beforehand and used to enable participants articulate their expectations regarding the opportunities and risks of AI-assisted decision-making. In addition, 6 high-level principles for responsible AI were used as probing themes to evoke further consideration of the risks associated with using AI-DSSs in LTC. Furthermore, the participants were asked to brainstorm possible strategies and actions in the design, implementation, and use of AI-DSSs to address or mitigate these risks. A thematic analysis was performed to identify the opportunities and risks of AI-assisted decision-making in nursing practice and the associated prerequisites for responsible innovation in this area. Results: The stance of care professionals on the use of AI-DSSs is not a matter of purely positive or negative expectations but rather a nuanced interplay of positive and negative elements that lead to a weighed perception of the prerequisites for responsible AI-assisted decision-making. Both opportunities and risks were identified in relation to the early identification of care needs, guidance in devising care strategies, shared decision-making, and the workload of and work experience of caregivers. To optimally balance the opportunities and risks of AI-assisted decision-making, seven categories of prerequisites for responsible AI-assisted decision-making in nursing practice were identified: (1) regular deliberation on data collection; (2) a balanced proactive nature of AI-DSSs; (3) incremental advancements aligned with trust and experience; (4) customization for all user groups, including clients and caregivers; (5) measures to counteract bias and narrow perspectives; (6) human-centric learning loops; and (7) the routinization of using AI-DSSs. Conclusions: The opportunities of AI-assisted decision-making in nursing practice could turn into drawbacks depending on the specific shaping of the design and deployment of AI-DSSs. Therefore, we recommend considering the responsible use of AI-DSSs as a balancing act. Moreover, considering the interrelatedness of the identified prerequisites, we call for various actors, including developers and users of AI-DSSs, to cohesively address the different factors important to the responsible embedding of AI-DSSs in practice. (©Dirk R M Lukkien, Nathalie E Stolwijk, Sima Ipakchian Askari, Bob M Hofstede, Henk Herman Nap, Wouter P C Boon, Alexander Peine, Ellen H M Moors, Mirella M N Minkman. Originally published in JMIR Nursing (https://nursing.jmir.org), 25.07.2024.)
Databáze:	MEDLINE
Externí odkaz:	Zobrazit plný text záznamu