Realistic endoscopic image generation method using virtual-to-real image-domain translation
Autor: | Masahiro Oda, Kiyohito Tanaka, Hirotsugu Takabatake, Masaki Mori, Hiroshi Natori, Kensaku Mori |
---|---|
Jazyk: | angličtina |
Rok vydání: | 2019 |
Předmět: |
realistic images
data visualisation rendering (computer graphics) computerised tomography endoscopes biological organs image segmentation medical image processing virtual reality high-quality image-domain translation results image cleansing image-domain translator realistic endoscopic image generation method realistic image generation method endoscopic simulation systems endoscope insertions nonrealistic virtual endoscopic images unpaired virtual images real endoscopic images shallow u-net deep u-net endoscopic treatment endoscopic diagnosis Medical technology R855-855.5 |
Zdroj: | Healthcare Technology Letters (2019) |
Druh dokumentu: | article |
ISSN: | 2053-3713 |
DOI: | 10.1049/htl.2019.0071 |
Popis: | A realistic image generation method for visualisation in endoscopic simulation systems is proposed in this study. Endoscopic diagnosis and treatment are performed in many hospitals. To reduce complications related to endoscope insertions, endoscopic simulation systems are used for training or rehearsal of endoscope insertions. However, current simulation systems generate non-realistic virtual endoscopic images. To improve the value of the simulation systems, improvement of the reality of their generated images is necessary. The authors propose a realistic image generation method for endoscopic simulation systems. Virtual endoscopic images are generated by using a volume rendering method from a CT volume of a patient. They improve the reality of the virtual endoscopic images using a virtual-to-real image-domain translation technique. The image-domain translator is implemented as a fully convolutional network (FCN). They train the FCN by minimising a cycle consistency loss function. The FCN is trained using unpaired virtual and real endoscopic images. To obtain high-quality image-domain translation results, they perform an image cleansing to the real endoscopic image set. They tested to use the shallow U-Net, U-Net, deep U-Net, and U-Net having residual units as the image-domain translator. The deep U-Net and U-Net having residual units generated quite realistic images. |
Databáze: | Directory of Open Access Journals |
Externí odkaz: |