Evaluation of the impact of artificial intelligence-assisted image interpretation on the diagnostic performance of clinicians in identifying pneumothoraces on plain chest X-ray: a multi-case multi-reader study.

Autor:	Novak A; Emergency Department, Oxford University Hospitals NHS Foundation Trust, Oxford, UK alex.novak@ouh.nhs.uk., Ather S; Radiology Department, Oxford University Hospitals, Oxford, UK., Gill A; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Aylward P; Report and Image Quality Control (RAIQC), London, UK, UK., Maskell G; Royal Cornwall Hospitals NHS Trust, Truro, Cornwall, UK., Cowell GW; Queen Elizabeth University Hospital Campus, Glasgow, UK., Espinosa Morgado AT; Emergency Department, Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Duggan T; Buckinghamshire Healthcare NHS Trust, Amersham, UK., Keevill M; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Gamble O; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Akrama O; Emergency Department, Royal Berkshire NHS Foundation Trust, Reading, UK., Belcher E; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Taberham R; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Hallifax R; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Bahra J; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Banerji A; Buckinghamshire Healthcare NHS Trust, Amersham, UK., Bailey J; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., James A; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Ansaripour A; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Spence N; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Wrightson J; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Jarral W; Frimley Health NHS Foundation Trust, Frimley, UK., Barry S; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Bhatti S; Frimley Health NHS Foundation Trust, Frimley, UK., Astley K; Oxford University Hospitals NHS Foundation Trust, Oxford, UK., Shadmaan A; GE Healthcare Diagnostic Imaging, Little Chalfont, Buckinghamshire, UK., Ghelman S; GE Healthcare, Chicago, Illinois, USA., Baenen A; GE Healthcare Ltd, Chicago, Illinois, USA., Oke J; University of Oxford Greyfriars, Oxford, UK., Bloomfield C; University of Oxford, Oxford, Oxfordshire, UK., Johnson H; University of Oxford, Oxford, Oxfordshire, UK., Beggs M; University of Oxford, Oxford, Oxfordshire, UK., Gleeson F; Radiology Department, Oxford University Hospitals, Oxford, UK.
Jazyk:	angličtina
Zdroj:	Emergency medicine journal : EMJ [Emerg Med J] 2024 Sep 25; Vol. 41 (10), pp. 602-609. Date of Electronic Publication: 2024 Sep 25.
DOI:	10.1136/emermed-2023-213620
Abstrakt:	Background: Artificial intelligence (AI)-assisted image interpretation is a fast-developing area of clinical innovation. Most research to date has focused on the performance of AI-assisted algorithms in comparison with that of radiologists rather than evaluating the algorithms' impact on the clinicians who often undertake initial image interpretation in routine clinical practice. This study assessed the impact of AI-assisted image interpretation on the diagnostic performance of frontline acute care clinicians for the detection of pneumothoraces (PTX). Methods: A multicentre blinded multi-case multi-reader study was conducted between October 2021 and January 2022. The online study recruited 18 clinician readers from six different clinical specialties, with differing levels of seniority, across four English hospitals. The study included 395 plain CXR images, 189 positive for PTX and 206 negative. The reference standard was the consensus opinion of two thoracic radiologists with a third acting as arbitrator. General Electric Healthcare Critical Care Suite (GEHC CCS) PTX algorithm was applied to the final dataset. Readers individually interpreted the dataset without AI assistance, recording the presence or absence of a PTX and a confidence rating. Following a 'washout' period, this process was repeated including the AI output. Results: Analysis of the performance of the algorithm for detecting or ruling out a PTX revealed an overall AUROC of 0.939. Overall reader sensitivity increased by 11.4% (95% CI 4.8, 18.0, p=0.002) from 66.8% (95% CI 57.3, 76.2) unaided to 78.1% aided (95% CI 72.2, 84.0, p=0.002), specificity 93.9% (95% CI 90.9, 97.0) without AI to 95.8% (95% CI 93.7, 97.9, p=0.247). The junior reader subgroup showed the largest improvement at 21.7% (95% CI 10.9, 32.6), increasing from 56.0% (95% CI 37.7, 74.3) to 77.7% (95% CI 65.8, 89.7, p<0.01). Conclusion: The study indicates that AI-assisted image interpretation significantly enhances the diagnostic accuracy of clinicians in detecting PTX, particularly benefiting less experienced practitioners. While overall interpretation time remained unchanged, the use of AI improved diagnostic confidence and sensitivity, especially among junior clinicians. These findings underscore the potential of AI to support less skilled clinicians in acute care settings. Competing Interests: Competing interests: AS, SG and AB are employed by GE HealthCare, a key NCIMI stakeholder. AN and CB have undertaken paid consultancy work for GEHC. PA, SA and FG are employees of Report and Image Quality Control (www.raiqc.com), a spin-out company from Oxford University Hospitals NHS Foundation Trust. (© Author(s) (or their employer(s)) 2024. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.)
Databáze:	MEDLINE
Externí odkaz:	Zobrazit plný text záznamu