A Holographic Augmented Reality Interface for Visualizing of MRI Data and Planning of Neurosurgical Procedures

Autor: Ernst L. Leiss, Ioannis Seimenis, Andrew G. Webb, Nikolaos V. Tsekos, Aaron T. Becker, Eleftherios P. Pappas, Theodosios Birbilis, Cristina Marie Morales Mojica, Jose D. Velazco-Garcia
Rok vydání: 2021
Předmět:
Zdroj: Journal of Digital Imaging, 34(4), 1014-1025. SPRINGER
J Digit Imaging
ISSN: 1618-727X
0897-1889
DOI: 10.1007/s10278-020-00412-3
Popis: The recent introduction of wireless head-mounted displays (HMD) promises to enhance 3D image visualization by immersing the user into 3D morphology. This work introduces a prototype holographic augmented reality (HAR) interface for the 3D visualization of magnetic resonance imaging (MRI) data for the purpose of planning neurosurgical procedures. The computational platform generates a HAR scene that fuses pre-operative MRI sets, segmented anatomical structures, and a tubular tool for planning an access path to the targeted pathology. The operator can manipulate the presented images and segmented structures and perform path-planning using voice and gestures. On-the-fly, the software uses defined forbidden-regions to prevent the operator from harming vital structures. In silico studies using the platform with a HoloLens HMD assessed its functionality and the computational load and memory for different tasks. A preliminary qualitative evaluation revealed that holographic visualization of high-resolution 3D MRI data offers an intuitive and interactive perspective of the complex brain vasculature and anatomical structures. This initial work suggests that immersive experiences may be an unparalleled tool for planning neurosurgical procedures.
Databáze: OpenAIRE