Accuracy of artificial intelligence model for infectious keratitis classification: a systematic review and meta-analysis.

Autor: Sarayar R; Residency Program in Ophthalmology Faculty of Medicine, Universitas Indonesia, Jakarta, Indonesia., Lestari YD; Department of Ophthalmology, Faculty of Medicine Universitas Indonesia - Cipto Mangunkusumo General Hospital, Jakarta, Indonesia., Setio AAA; Digital Technology and Innovation, Siemens Healthineers, Erlangen, Germany., Sitompul R; Department of Ophthalmology, Faculty of Medicine Universitas Indonesia - Cipto Mangunkusumo General Hospital, Jakarta, Indonesia.
Jazyk: angličtina
Zdroj: Frontiers in public health [Front Public Health] 2023 Nov 24; Vol. 11, pp. 1239231. Date of Electronic Publication: 2023 Nov 24 (Print Publication: 2023).
DOI: 10.3389/fpubh.2023.1239231
Abstrakt: Background: Infectious keratitis (IK) is a sight-threatening condition requiring immediate definite treatment. The need for prompt treatment heavily depends on timely diagnosis. The diagnosis of IK, however, is challenged by the drawbacks of the current "gold standard." The poorly differentiated clinical features, the possibility of low microbial culture yield, and the duration for culture are the culprits of delayed IK treatment. Deep learning (DL) is a recent artificial intelligence (AI) advancement that has been demonstrated to be highly promising in making automated diagnosis in IK with high accuracy. However, its exact accuracy is not yet elucidated. This article is the first systematic review and meta-analysis that aims to assess the accuracy of available DL models to correctly classify IK based on etiology compared to the current gold standards.
Methods: A systematic search was carried out in PubMed, Google Scholars, Proquest, ScienceDirect, Cochrane and Scopus. The used keywords are: "Keratitis," "Corneal ulcer," "Corneal diseases," "Corneal lesions," "Artificial intelligence," "Deep learning," and "Machine learning." Studies including slit lamp photography of the cornea and validity study on DL performance were considered. The primary outcomes reviewed were the accuracy and classification capability of the AI machine learning/DL algorithm. We analyzed the extracted data with the MetaXL 5.2 Software.
Results: A total of eleven articles from 2002 to 2022 were included with a total dataset of 34,070 images. All studies used convolutional neural networks (CNNs), with ResNet and DenseNet models being the most used models across studies. Most AI models outperform the human counterparts with a pooled area under the curve (AUC) of 0.851 and accuracy of 96.6% in differentiating IK vs. non-IK and pooled AUC 0.895 and accuracy of 64.38% for classifying bacterial keratitis (BK) vs. fungal keratitis (FK).
Conclusion: This study demonstrated that DL algorithms have high potential in diagnosing and classifying IK with accuracy that, if not better, is comparable to trained corneal experts. However, various factors, such as the unique architecture of DL model, the problem with overfitting, image quality of the datasets, and the complex nature of IK itself, still hamper the universal applicability of DL in daily clinical practice.
Competing Interests: AS was employed by the company Siemens Healthineers. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
(Copyright © 2023 Sarayar, Lestari, Setio and Sitompul.)
Databáze: MEDLINE