Real-Time Tool Localization for Laparoscopic Surgery Using Convolutional Neural Network

Autor: Diego Benavides, Ana Cisnal, Carlos Fontúrbel, Eusebio de la Fuente, Juan Carlos Fraile
Jazyk: angličtina
Rok vydání: 2024
Předmět:
Zdroj: Sensors, Vol 24, Iss 13, p 4191 (2024)
Druh dokumentu: article
ISSN: 1424-8220
DOI: 10.3390/s24134191
Popis: Partially automated robotic systems, such as camera holders, represent a pivotal step towards enhancing efficiency and precision in surgical procedures. Therefore, this paper introduces an approach for real-time tool localization in laparoscopy surgery using convolutional neural networks. The proposed model, based on two Hourglass modules in series, can localize up to two surgical tools simultaneously. This study utilized three datasets: the ITAP dataset, alongside two publicly available datasets, namely Atlas Dione and EndoVis Challenge. Three variations of the Hourglass-based models were proposed, with the best model achieving high accuracy (92.86%) and frame rates (27.64 FPS), suitable for integration into robotic systems. An evaluation on an independent test set yielded slightly lower accuracy, indicating limited generalizability. The model was further analyzed using the Grad-CAM technique to gain insights into its functionality. Overall, this work presents a promising solution for automating aspects of laparoscopic surgery, potentially enhancing surgical efficiency by reducing the need for manual endoscope manipulation.
Databáze: Directory of Open Access Journals
Nepřihlášeným uživatelům se plný text nezobrazuje