Can We Trust Deep Learning Based Diagnosis? The Impact of Domain Shift in Chest Radiograph Classification
| Autor: | Pedro Ballester, Eduardo Pooch, Rodrigo C. Barros |
|---|---|
| Rok vydání: | 2020 |
| Předmět: | |
| Zdroj: | Thoracic Image Analysis ISBN: 9783030624682 TIA@MICCAI |
| DOI: | 10.1007/978-3-030-62469-9_7 |
| Popis: | While deep learning models become more widespread, their ability to handle unseen data and generalize for any scenario is yet to be challenged. In medical imaging, there is a high heterogeneity of distributions among images based on the equipment that generates them and their parametrization. This heterogeneity triggers a common issue in machine learning called domain shift, which represents the difference between the training data distribution and the distribution of where a model is employed. A high domain shift often results in a poor generalization performance from the models. In this work, we evaluate the extent of which domain shift damages model performance on four of the largest datasets of chest radiographs. We show how training and testing with different datasets (e.g., training in ChestX-ray14 and testing in CheXpert) drastically affects model performance, posing a big question over the reliability of deep learning models trained on public datasets. We also show that models trained on CheXpert and MIMIC-CXR generalized better to other datasets. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|