Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning.

Autor: Robertshaw H; Surgical and Interventional Engineering, School of Biomedical Engineering and Imaging Sciences, Kings College London, London, UK., Karstensen L; AIBE, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany., Jackson B; Surgical and Interventional Engineering, School of Biomedical Engineering and Imaging Sciences, Kings College London, London, UK., Granados A; Surgical and Interventional Engineering, School of Biomedical Engineering and Imaging Sciences, Kings College London, London, UK., Booth TC; Surgical and Interventional Engineering, School of Biomedical Engineering and Imaging Sciences, Kings College London, London, UK. thomas.booth@kcl.ac.uk.; Department of Neuroradiology, Kings College Hospital, London, UK. thomas.booth@kcl.ac.uk.
Jazyk: angličtina
Zdroj: International journal of computer assisted radiology and surgery [Int J Comput Assist Radiol Surg] 2024 Aug; Vol. 19 (8), pp. 1569-1578. Date of Electronic Publication: 2024 Jun 17.
DOI: 10.1007/s11548-024-03208-w
Abstrakt: Purpose: Autonomous navigation of catheters and guidewires can enhance endovascular surgery safety and efficacy, reducing procedure times and operator radiation exposure. Integrating tele-operated robotics could widen access to time-sensitive emergency procedures like mechanical thrombectomy (MT). Reinforcement learning (RL) shows potential in endovascular navigation, yet its application encounters challenges without a reward signal. This study explores the viability of autonomous guidewire navigation in MT vasculature using inverse reinforcement learning (IRL) to leverage expert demonstrations.
Methods: Employing the Simulation Open Framework Architecture (SOFA), this study established a simulation-based training and evaluation environment for MT navigation. We used IRL to infer reward functions from expert behaviour when navigating a guidewire and catheter. We utilized the soft actor-critic algorithm to train models with various reward functions and compared their performance in silico.
Results: We demonstrated feasibility of navigation using IRL. When evaluating single- versus dual-device (i.e. guidewire versus catheter and guidewire) tracking, both methods achieved high success rates of 95% and 96%, respectively. Dual tracking, however, utilized both devices mimicking an expert. A success rate of 100% and procedure time of 22.6 s were obtained when training with a reward function obtained through 'reward shaping'. This outperformed a dense reward function (96%, 24.9 s) and an IRL-derived reward function (48%, 59.2 s).
Conclusions: We have contributed to the advancement of autonomous endovascular intervention navigation, particularly MT, by effectively employing IRL based on demonstrator expertise. The results underscore the potential of using reward shaping to efficiently train models, offering a promising avenue for enhancing the accessibility and precision of MT procedures. We envisage that future research can extend our methodology to diverse anatomical structures to enhance generalizability.
(© 2024. The Author(s).)
Databáze: MEDLINE
Externí odkaz: