CholecTriplet2021: A benchmark challenge for surgical action triplet recognition.

Autor: Nwoye CI; ICube, University of Strasbourg, CNRS, France. Electronic address: nwoye@unistra.fr., Alapatt D; ICube, University of Strasbourg, CNRS, France., Yu T; ICube, University of Strasbourg, CNRS, France., Vardazaryan A; IHU Strasbourg, France., Xia F; Department of Computer Science, University of Chicago, United States., Zhao Z; Department of Computer Science, University of Chicago, United States., Xia T; Lab for Medical Imaging and Digital Surgery, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, China., Jia F; Lab for Medical Imaging and Digital Surgery, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, China., Yang Y; School of Management, Hefei University of Technology, Hefei, China., Wang H; School of Management, Hefei University of Technology, Hefei, China., Yu D; Institue of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China., Zheng G; Institue of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China., Duan X; Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL 60439, United States., Getty N; Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL 60439, United States., Sanchez-Matilla R; Digital Surgery, a Medtronic Company, London, UK., Robu M; Digital Surgery, a Medtronic Company, London, UK., Zhang L; Institute of Automation, Chinese Academy of Sciences, China., Chen H; Institute of Automation, Chinese Academy of Sciences, China., Wang J; Department of Computer Science at School of Informatics, Xiamen University, Xiamen, China., Wang L; Department of Computer Science at School of Informatics, Xiamen University, Xiamen, China., Zhang B; Johnson & Johnson., Gerats B; Meander Medical Centre, The Netherlands., Raviteja S; Indian Institute of Technology Kharagpur, India., Sathish R; Indian Institute of Technology Kharagpur, India., Tao R; Institue of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China., Kondo S; Muroran Institute of Technology, Japan., Pang W; Department of Biomedical Engineering, National University of Singapore, Singapore., Ren H; Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong., Abbing JR; Meander Medical Centre, The Netherlands., Sarhan MH; Johnson & Johnson., Bodenstedt S; Department for Translational Surgical Oncology, National Center for Tumor Diseases Partner Site Dresden, Germany., Bhasker N; Department for Translational Surgical Oncology, National Center for Tumor Diseases Partner Site Dresden, Germany., Oliveira B; 2Ai School of Technology, IPCA, Barcelos, Portugal; Life and Health Science Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal; Algoritimi Center, School of Engineering, University of Minho, Guimeraes, Portugal., Torres HR; 2Ai School of Technology, IPCA, Barcelos, Portugal; Life and Health Science Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal; Algoritimi Center, School of Engineering, University of Minho, Guimeraes, Portugal., Ling L; School of Management, Hefei University of Technology, Hefei, China., Gaida F; Technical University of Munich, Germany., Czempiel T; Technical University of Munich, Germany., Vilaça JL; 2Ai School of Technology, IPCA, Barcelos, Portugal., Morais P; 2Ai School of Technology, IPCA, Barcelos, Portugal., Fonseca J; Algoritimi Center, School of Engineering, University of Minho, Guimeraes, Portugal., Egging RM; Meander Medical Centre, The Netherlands., Wijma IN; Meander Medical Centre, The Netherlands., Qian C; Institute of Automation, Chinese Academy of Sciences, China., Bian G; Institute of Automation, Chinese Academy of Sciences, China., Li Z; Institute of Automation, Chinese Academy of Sciences, China., Balasubramanian V; Indian Institute of Technology Kharagpur, India., Sheet D; Indian Institute of Technology Kharagpur, India., Luengo I; Digital Surgery, a Medtronic Company, London, UK., Zhu Y; School of Management, Hefei University of Technology, Hefei, China., Ding S; School of Management, Hefei University of Technology, Hefei, China., Aschenbrenner JA; Johnson & Johnson., van der Kar NE; Meander Medical Centre, The Netherlands., Xu M; Department of Biomedical Engineering, National University of Singapore, Singapore., Islam M; Department of Biomedical Engineering, National University of Singapore, Singapore., Seenivasan L; Department of Biomedical Engineering, National University of Singapore, Singapore., Jenke A; Department for Translational Surgical Oncology, National Center for Tumor Diseases Partner Site Dresden, Germany., Stoyanov D; Digital Surgery, a Medtronic Company, London, UK; Wellcome/EPSRC Center for Interventional and Surgical Science, University College London, UK., Mutter D; IHU Strasbourg, France; University Hospital of Strasbourg, France., Mascagni P; ICube, University of Strasbourg, CNRS, France; Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy., Seeliger B; ICube, University of Strasbourg, CNRS, France; IHU Strasbourg, France; University Hospital of Strasbourg, France., Gonzalez C; IHU Strasbourg, France; University Hospital of Strasbourg, France., Padoy N; ICube, University of Strasbourg, CNRS, France; IHU Strasbourg, France.
Jazyk: angličtina
Zdroj: Medical image analysis [Med Image Anal] 2023 May; Vol. 86, pp. 102803. Date of Electronic Publication: 2023 Mar 27.
DOI: 10.1016/j.media.2023.102803
Abstrakt: Context-aware decision support in the operating room can foster surgical safety and efficiency by leveraging real-time feedback from surgical workflow analysis. Most existing works recognize surgical activities at a coarse-grained level, such as phases, steps or events, leaving out fine-grained interaction details about the surgical activity; yet those are needed for more helpful AI assistance in the operating room. Recognizing surgical actions as triplets of ‹instrument, verb, target› combination delivers more comprehensive details about the activities taking place in surgical videos. This paper presents CholecTriplet2021: an endoscopic vision challenge organized at MICCAI 2021 for the recognition of surgical action triplets in laparoscopic videos. The challenge granted private access to the large-scale CholecT50 dataset, which is annotated with action triplet information. In this paper, we present the challenge setup and the assessment of the state-of-the-art deep learning methods proposed by the participants during the challenge. A total of 4 baseline methods from the challenge organizers and 19 new deep learning algorithms from the competing teams are presented to recognize surgical action triplets directly from surgical videos, achieving mean average precision (mAP) ranging from 4.2% to 38.1%. This study also analyzes the significance of the results obtained by the presented approaches, performs a thorough methodological comparison between them, in-depth result analysis, and proposes a novel ensemble method for enhanced recognition. Our analysis shows that surgical workflow analysis is not yet solved, and also highlights interesting directions for future research on fine-grained surgical activity recognition which is of utmost importance for the development of AI in surgery.
Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
(Copyright © 2023 Elsevier B.V. All rights reserved.)
Databáze: MEDLINE
Externí odkaz: