SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images

Autor: Malte Hoffmann, Douglas N. Greve, Benjamin Billot, Juan Eugenio Iglesias, Adrian V. Dalca, Bruce Fischl
Rok vydání: 2022
Předmět:
FOS: Computer and information sciences
Optimization problem
Computer science
Computer Vision and Pattern Recognition (cs.CV)
Computer Science - Computer Vision and Pattern Recognition
ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION
Image registration
Neuroimaging
Geometric shape
030218 nuclear medicine & medical imaging
03 medical and health sciences
0302 clinical medicine
Image Processing
Computer-Assisted

FOS: Electrical engineering
electronic engineering
information engineering

Computer vision
Electrical and Electronic Engineering
Invariant (computer science)
Radiological and Ultrasound Technology
business.industry
Image and Video Processing (eess.IV)
Contrast (statistics)
Electrical Engineering and Systems Science - Image and Video Processing
Magnetic Resonance Imaging
Computer Science Applications
Range (mathematics)
Generative model
FOS: Biological sciences
Quantitative Biology - Neurons and Cognition
Neurons and Cognition (q-bio.NC)
Artificial intelligence
Focus (optics)
business
Software
Zdroj: IEEE Transactions on Medical Imaging. 41:543-558
ISSN: 1558-254X
0278-0062
DOI: 10.1109/tmi.2021.3116879
Popis: We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate the spatial correspondence between images, they solve an optimization problem for every new image pair. Learning-based techniques are fast at test time but limited to registering images with contrasts and geometric content similar to those seen during training. We propose to remove this dependency on training data by leveraging a generative strategy for diverse synthetic label maps and images that exposes networks to a wide range of variability, forcing them to learn more invariant features. This approach results in powerful networks that accurately generalize to a broad array of MRI contrasts. We present extensive experiments with a focus on 3D neuroimaging, showing that this strategy enables robust and accurate registration of arbitrary MRI contrasts even if the target contrast is not seen by the networks during training. We demonstrate registration accuracy surpassing the state of the art both within and across contrasts, using a single model. Critically, training on arbitrary shapes synthesized from noise distributions results in competitive performance, removing the dependency on acquired data of any kind. Additionally, since anatomical label maps are often available for the anatomy of interest, we show that synthesizing images from these dramatically boosts performance, while still avoiding the need for real intensity images. Our code is available at https://w3id.org/synthmorph.
16 pages, 15 figures, 3 tables, deformable image registration, data independence, deep learning, MRI-contrast invariance, anatomy agnosticism, final published version
Databáze: OpenAIRE