Enhanced detection of fetal pose in 3D MRI by Deep Reinforcement Learning with physical structure priors on anatomy.

Autor: Zhang M; Department of Electrical Engineering and Computer Science, MIT, Cambridge, MA, USA., Xu J; Department of Electrical Engineering and Computer Science, MIT, Cambridge, MA, USA., Turk EA; Fetal-Neonatal Neuroimaging and Developmental Science Center, Boston Children's Hospital, Boston, MA, USA., Grant PE; Fetal-Neonatal Neuroimaging and Developmental Science Center, Boston Children's Hospital, Boston, MA, USA.; Harvard Medical School, Boston, MA, USA., Golland P; Department of Electrical Engineering and Computer Science, MIT, Cambridge, MA, USA.; Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA., Adalsteinsson E; Department of Electrical Engineering and Computer Science, MIT, Cambridge, MA, USA.; Institute for Medical Engineering and Science, MIT, Cambridge, MA, USA.
Jazyk: angličtina
Zdroj: Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention [Med Image Comput Comput Assist Interv] 2020 Oct; Vol. 12266, pp. 396-405. Date of Electronic Publication: 2020 Sep 29.
DOI: 10.1007/978-3-030-59725-2_38
Abstrakt: Fetal MRI is heavily constrained by unpredictable and substantial fetal motion that causes image artifacts and limits the set of viable diagnostic image contrasts. Current mitigation of motion artifacts is predominantly performed by fast, single-shot MRI and retrospective motion correction. Estimation of fetal pose in real time during MRI stands to benefit prospective methods to detect and mitigate fetal motion artifacts where inferred fetal motion is combined with online slice prescription with low-latency decision making. Current developments of deep reinforcement learning (DRL), offer a novel approach for fetal landmarks detection. In this task 15 agents are deployed to detect 15 landmarks simultaneously by DRL. The optimization is challenging, and here we propose an improved DRL that incorporates priors on physical structure of the fetal body. First, we use graph communication layers to improve the communication among agents based on a graph where each node represents a fetal-body landmark. Further, additional reward based on the distance between agents and physical structures such as the fetal limbs is used to fully exploit physical structure. Evaluation of this method on a repository of 3-mm resolution in vivo data demonstrates a mean accuracy of landmark estimation within 10 mm of ground truth as 87.3%, and a mean error of 6.9 mm. The proposed DRL for fetal pose landmark search demonstrates a potential clinical utility for online detection of fetal motion that guides real-time mitigation of motion artifacts as well as health diagnosis during MRI of the pregnant mother.
Databáze: MEDLINE