Dynamic contrast-enhanced computed tomography diagnosis of primary liver cancers using transfer learning of pretrained convolutional neural networks: Is registration of multiphasic images necessary?

Autor: Yasunari Fujinaga, Akira Yamada, Sachie Fujita, Daisuke Komatsu, Fumihito Ichinohe, Eriko Yoshizawa, Kazuki Oyama
Rok vydání: 2019
Předmět:
Male
Carcinoma
Hepatocellular
0206 medical engineering
Biomedical Engineering
Image registration
Contrast Media
Health Informatics
Computed tomography
02 engineering and technology
Convolutional neural network
030218 nuclear medicine & medical imaging
03 medical and health sciences
0302 clinical medicine
medicine
Image Processing
Computer-Assisted
Humans
Radiology
Nuclear Medicine and imaging
Aged
Retrospective Studies
medicine.diagnostic_test
Pixel
business.industry
Poorly differentiated
Liver Neoplasms
Reproducibility of Results
Dynamic Contrast Enhanced Computed Tomography
General Medicine
Middle Aged
020601 biomedical engineering
Computer Graphics and Computer-Aided Design
Computer Science Applications
Surgery
Female
Computer Vision and Pattern Recognition
Neural Networks
Computer
Transfer of learning
Nuclear medicine
business
Early phase
Tomography
Spiral Computed
Algorithms
Zdroj: International journal of computer assisted radiology and surgery. 14(8)
ISSN: 1861-6429
Popis: To evaluate the effect of image registration on the diagnostic performance of transfer learning (TL) using pretrained convolutional neural networks (CNNs) and three-phasic dynamic contrast-enhanced computed tomography (DCE-CT) for primary liver cancers. We retrospectively evaluated 215 consecutive patients with histologically proven primary liver cancers, including six early, 58 well-differentiated, 109 moderately differentiated, 29 poorly differentiated hepatocellular carcinomas (HCCs), and 13 non-HCC malignant lesions containing cholangiocellular components. We performed TL using various pretrained CNNs and preoperative three-phasic DCE-CT images. Three-phasic DCE-CT images were manually registered to correct respiratory motion. The registered DCE-CT images were then assigned to the three color channels of an input image for TL: pre-contrast, early phase, and delayed phase images for the blue, red, and green channels, respectively. To evaluate the effects of image registration, the registered input image was intentionally misaligned in the three color channels by pixel shifts, rotations, and skews with various degrees. The diagnostic performances (DP) of the pretrained CNNs after TL in the test set were compared by three general radiologists (GRs) and two experienced abdominal radiologists (ARs). The effects of misalignment in the input image and the type of pretrained CNN on the DP were statistically evaluated. The mean DPs for histological subtype classification and differentiation in primary malignant liver tumors on DCE-CT for GR and AR were 39.1%, and 47.9%, respectively. The highest mean DPs for CNNs after TL with pixel shifts, rotations, and skew misalignments were 44.1%, 44.2%, and 43.7%, respectively. Two-way analysis of variance revealed that the DP is significantly affected by the type of pretrained CNN (P = 0.0001), but not by misalignments in input images other than skew deformations. TL using pretrained CNNs is robust against misregistration of multiphasic images and comparable to experienced ARs in classifying primary liver cancers using three-phasic DCE-CT.
Databáze: OpenAIRE
Externí odkaz: