Artificial Intelligence-Based Hazard Detection in Robotic-Assisted Single-Incision Oncologic Surgery.

Autor: Rus G; Research Center for Industrial Robots Simulation and Testing-CESTER, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania., Andras I; Department of Urology, 'Iuliu Hatieganu' University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania., Vaida C; Research Center for Industrial Robots Simulation and Testing-CESTER, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania., Crisan N; Department of Urology, 'Iuliu Hatieganu' University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania., Gherman B; Research Center for Industrial Robots Simulation and Testing-CESTER, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania., Radu C; Department of Internal Medicine, 'Iuliu Hatieganu' University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania., Tucan P; Research Center for Industrial Robots Simulation and Testing-CESTER, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania., Iakab S; Research Center for Industrial Robots Simulation and Testing-CESTER, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania., Hajjar NA; Department of Urology, 'Iuliu Hatieganu' University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania.; Department of Surgery, 'Iuliu Hatieganu' University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania., Pisla D; Research Center for Industrial Robots Simulation and Testing-CESTER, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania.
Jazyk: angličtina
Zdroj: Cancers [Cancers (Basel)] 2023 Jun 28; Vol. 15 (13). Date of Electronic Publication: 2023 Jun 28.
DOI: 10.3390/cancers15133387
Abstrakt: The Problem: Single-incision surgery is a complex procedure in which any additional information automatically collected from the operating field can be of significance. While the use of robotic devices has greatly improved surgical outcomes, there are still many unresolved issues. One of the major surgical complications, with higher occurrence in cancer patients, is intraoperative hemorrhages, which if detected early, can be more efficiently controlled.
Aim: This paper proposes a hazard detection system which incorporates the advantages of both Artificial Intelligence (AI) and Augmented Reality (AR) agents, capable of identifying, in real-time, intraoperative bleedings, which are subsequently displayed on a Hololens 2 device.
Methods: The authors explored the different techniques for real-time processing and determined, based on a critical analysis, that YOLOv5 is one of the most promising solutions. An innovative, real-time, bleeding detection system, developed using the YOLOv5 algorithm and the Hololens 2 device, was evaluated on different surgical procedures and tested in multiple configurations to obtain the optimal prediction time and accuracy.
Results: The detection system was able to identify the bleeding occurrence in multiple surgical procedures with a high rate of accuracy. Once detected, the area of interest was marked with a bounding box and displayed on the Hololens 2 device. During the tests, the system was able to differentiate between bleeding occurrence and intraoperative irrigation; thus, reducing the risk of false-negative and false-positive results.
Conclusion: The current level of AI and AR technologies enables the development of real-time hazard detection systems as efficient assistance tools for surgeons, especially in high-risk interventions.
Databáze: MEDLINE
Externí odkaz:
Nepřihlášeným uživatelům se plný text nezobrazuje