On the Necessity of Fine-Tuned Convolutional Neural Networks for Medical Imaging
Autor: | R. Todd Hurst, Christopher B. Kendall, Michael B. Gotway, Jae Y. Shin, Suryakanth R. Gurudu, Nima Tajbakhsh, Jianming Liang |
---|---|
Rok vydání: | 2017 |
Předmět: |
Scheme (programming language)
Modalities Training set Computer science business.industry 02 engineering and technology Performance gap Machine learning computer.software_genre Convolutional neural network 03 medical and health sciences 0302 clinical medicine Scratch 0202 electrical engineering electronic engineering information engineering Medical imaging 020201 artificial intelligence & image processing Artificial intelligence business computer Knowledge transfer 030217 neurology & neurosurgery computer.programming_language |
Zdroj: | Deep Learning and Convolutional Neural Networks for Medical Image Computing ISBN: 9783319429984 Deep Learning and Convolutional Neural Networks for Medical Image Computing |
Popis: | This study aims to address two central questions. First, are fine-tuned convolutional neural networks (CNNs) necessary for medical imaging applications? In response, we considered four medical vision tasks from three different medical imaging modalities, and studied the necessity of fine-tuned CNNs under varying amounts of training data. Second, to what extent the knowledge is to be transferred? In response, we proposed a layer-wise fine-tuning scheme to examine how the extent or depth of fine-tuning contributes to the success of knowledge transfer. Our experiments consistently showed that the use of a pre-trained CNN with adequate fine-tuning outperformed or, in the worst case, performed as well as a CNN trained from scratch. The performance gap widened when reduced training sets were used for training and fine-tuning. Our results further revealed that the required level of fine-tuning differed from one application to another, suggesting that neither shallow tuning nor deep tuning may be the optimal choice for a particular application. Layer-wise fine-tuning may offer a practical way to reach the best performance for the application at hand based on the amount of available data. We conclude that knowledge transfer from natural images is necessary and that the level of tuning should be chosen experimentally. |
Databáze: | OpenAIRE |
Externí odkaz: |