Measuring the bias of incorrect application of feature selection when using cross-validation in radiomics
| Autor: | Aydin Demircioğlu |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
Measure (data warehouse)
Radiomics business.industry Medizin R895-920 Feature selection Pattern recognition Cross-validation Medical physics. Medical radiology. Nuclear medicine Bias Medizinische Fakultät » Universitätsklinikum Essen » Institut für Diagnostische und Interventionelle Radiologie und Neuroradiologie Machine learning Medicine Original Article Radiology Nuclear Medicine and imaging ddc:610 Artificial intelligence business |
| Zdroj: | Insights into Imaging, Vol 12, Iss 1, Pp 1-10 (2021) Insights into Imaging |
| ISSN: | 1869-4101 |
| Popis: | Background Many studies in radiomics are using feature selection methods to identify the most predictive features. At the same time, they employ cross-validation to estimate the performance of the developed models. However, if the feature selection is performed before the cross-validation, data leakage can occur, and the results can be biased. To measure the extent of this bias, we collected ten publicly available radiomics datasets and conducted two experiments. First, the models were developed by incorrectly applying the feature selection prior to cross-validation. Then, the same experiment was conducted by applying feature selection correctly within cross-validation to each fold. The resulting models were then evaluated against each other in terms of AUC-ROC, AUC-F1, and Accuracy. Results Applying the feature selection incorrectly prior to the cross-validation showed a bias of up to 0.15 in AUC-ROC, 0.29 in AUC-F1, and 0.17 in Accuracy. Conclusions Incorrect application of feature selection and cross-validation can lead to highly biased results for radiomic datasets. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
| Nepřihlášeným uživatelům se plný text nezobrazuje | K zobrazení výsledku je třeba se přihlásit. |