A shape-constraint adversarial framework with instance-normalized spatio-temporal features for inter-fetal membrane segmentation
Autor: | Leonardo S. Mattos, Emanuele Frontoni, Alessandro Casella, Sara Moccia, Dario Paladini, Elena De Momi |
---|---|
Rok vydání: | 2020 |
Předmět: |
Computer science
Image quality Placenta Pixel connectivity Extraembryonic Membranes Health Informatics 030218 nuclear medicine & medical imaging 03 medical and health sciences 0302 clinical medicine Pregnancy Encoding (memory) Humans Radiology Nuclear Medicine and imaging Segmentation Closing (morphology) Block (data storage) Radiological and Ultrasound Technology business.industry Deep learning Fetoscopy Pattern recognition Fetofetal Transfusion Computer Graphics and Computer-Aided Design Identification (information) Female Computer Vision and Pattern Recognition Artificial intelligence Laser Therapy business 030217 neurology & neurosurgery |
Zdroj: | Medical image analysis. 70 |
ISSN: | 1361-8423 |
Popis: | Background and Objectives During Twin-to-Twin Transfusion Syndrome (TTTS), abnormal vascular anastomoses in the monochorionic placenta can produce uneven blood flow between the fetuses. In the current practice, this syndrome is surgically treated by closing the abnormal connections using laser ablation. Surgeons commonly use the inter-fetal membrane as a reference. Limited field of view, low fetoscopic image quality and high inter-subject variability make the membrane identification a challenging task. However, currently available tools are not optimal for automatic membrane segmentation in fetoscopic videos, due to membrane texture homogeneity and high illumination variability. Methods To tackle these challenges, we present a new deep-learning framework for inter-fetal membrane segmentation on in-vivo fetoscopic videos. The framework enhances existing architectures by (i) encoding a novel (instance-normalized) dense block, invariant to illumination changes, that extracts spatio-temporal features to enforce pixel connectivity in time, and (ii) relying on an adversarial training, which constrains macro appearance. Results We performed a comprehensive validation using 20 different videos (2000 frames) from 20 different surgeries, achieving a mean Dice Similarity Coefficient of 0.8780 ± 0.1383 . Conclusions The proposed framework has great potential to positively impact the actual surgical practice for TTTS treatment, allowing the implementation of surgical guidance systems that can enhance context awareness and potentially lower the duration of the surgeries. |
Databáze: | OpenAIRE |
Externí odkaz: |