Graph Transformers for Characterization and Interpretation of Surgical Margins
| Autor: | Martin Kaufmann, Julie Wallis, Shaila J. Merchant, Kathryn Logan, Alice M. L. Santilli, Gabor Fichtinger, Sonal Varma, C. Jay Engel, Amoon Jamzad, Faranak Akbarifar, Parvin Mousavi, John F. Rudan, Kevin Yi Mi Ren |
|---|---|
| Rok vydání: | 2021 |
| Předmět: | |
| Zdroj: | Medical Image Computing and Computer Assisted Intervention – MICCAI 2021 ISBN: 9783030872335 MICCAI (7) |
| DOI: | 10.1007/978-3-030-87234-2_9 |
| Popis: | PURPOSE: Deployment of deep models for clinical decision making should not only provide predicted outcomes, but also insights on how decisions are made. Considering the interpretability of Transformer models, and the power of graph networks in analyzing the inherent hierarchy of biological signals, a combined approach would be the next generation solution in computer aided interventions. In this study, we propose a framework for classification and visualization of surgical mass spectrometry data using Graph Transformer model to empower the interpretability of breast surgical margin assessment. METHODS: Using the iKnife, 144 burns (103 normal, 41 cancer) were collected and converted to multi-level graph structures. A Graph Transformer model was modified to output the intermediate attention parameters of the network. Beside ablation and prospective study, we propose multiple attention visualization approaches to facilitate the interpretability. RESULTS: In a 4-fold cross validation experiment, an average classification AUC of 95.6% was achieved, outperforming baseline models. We could also distinguish and visualize clear pattern of attention difference between burns. For instance, cancerous and normal burns gather more attention in the lower and higher subbands of the spectra respectively. Looking at cancer subtype prospectively, a pattern of cancer progression was also observed in the attention features. CONCLUSION: Graph Transformers are powerful in providing high network interpretability. When paired with proper visualization, they can be deployed for computer assisted interventions. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|