Stereo reconstruction from microscopic images for computer-assisted ophthalmic surgery.

Autor: Peter R; Carl Zeiss AG, Oberkochen, Germany. rebekka.peter@zeiss.com.; Laboratory for Surgical Planning and Robotic Cognition (SPARC), Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany. rebekka.peter@zeiss.com., Moreira S; Carl Zeiss AG, Oberkochen, Germany.; Institute for Systems and Robotics, Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal., Tagliabue E; Carl Zeiss AG, Oberkochen, Germany., Hillenbrand M; Carl Zeiss AG, Oberkochen, Germany., Nunes RG; Institute for Systems and Robotics, Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal., Mathis-Ullrich F; Laboratory for Surgical Planning and Robotic Cognition (SPARC), Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.
Jazyk: angličtina
Zdroj: International journal of computer assisted radiology and surgery [Int J Comput Assist Radiol Surg] 2024 Jun 04. Date of Electronic Publication: 2024 Jun 04.
DOI: 10.1007/s11548-024-03177-0
Abstrakt: Purpose: This work presents a novel platform for stereo reconstruction in anterior segment ophthalmic surgery to enable enhanced scene understanding, especially depth perception, for advanced computer-assisted eye surgery by effectively addressing the lack of texture and corneal distortions artifacts in the surgical scene.
Methods: The proposed platform for stereo reconstruction uses a two-step approach: generating a sparse 3D point cloud from microscopic images, deriving a dense 3D representation by fitting surfaces onto the point cloud, and considering geometrical priors of the eye anatomy. We incorporate a pre-processing step to rectify distortion artifacts induced by the cornea's high refractive power, achieved by aligning a 3D phenotypical cornea geometry model to the images and computing a distortion map using ray tracing.
Results: The accuracy of 3D reconstruction is evaluated on stereo microscopic images of ex vivo porcine eyes, rigid phantom eyes, and synthetic photo-realistic images. The results demonstrate the potential of the proposed platform to enhance scene understanding via an accurate 3D representation of the eye and enable the estimation of instrument to layer distances in porcine eyes with a mean average error of 190  μ m , comparable to the scale of surgeons' hand tremor.
Conclusion: This work marks a significant advancement in stereo reconstruction for ophthalmic surgery by addressing corneal distortions, a previously often overlooked aspect in such surgical scenarios. This could improve surgical outcomes by allowing for intra-operative computer assistance, e.g., in the form of virtual distance sensors.
Competing Interests: Declarations. Conflict of interest: The authors declare that they have no conflict of interest. Ethical approval: This article does not contain any studies with human participants or animals performed by any of the authors. Informed consent: This articles does not contain patient data.
(© 2024. The Author(s).)
Databáze: MEDLINE
Externí odkaz: