Hierarchical Prediction of Registration Misalignment using a Convolutional LSTM: Application to Chest CT Scans
| Autor: | Sahar Yousefi, Hessam Sokooti, Mohamed S. Elmahdy, Marius Staring, Boudewijn P. F. Lelieveldt |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
General Computer Science
Computer science Decoding Feature extraction registration misalignment Image registration Convolutional neural network Set (abstract data type) Biomedical imaging Image resolution convolutional neural networks Medical imaging General Materials Science Computed tomography business.industry General Engineering Pattern recognition TK1-9971 hierarchical classification image registration Task analysis Artificial intelligence Electrical engineering. Electronics. Nuclear engineering business F1 score Decoding methods |
| Zdroj: | IEEE Access, 9 IEEE Access, Vol 9, Pp 62008-62020 (2021) IEEE Access, 9, 62008-62020. IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
| ISSN: | 2169-3536 |
| Popis: | In this paper we propose a supervised method to predict registration misalignment using convolutional neural networks (CNNs). This task is casted to a classification problem with multiple classes of misalignment: “correct” 0-3 mm, “poor” 3-6 mm and “wrong” over 6 mm. Rather than a direct prediction, we propose a hierarchical approach, where the prediction is gradually refined from coarse to fine. Our solution is based on a convolutional Long Short-Term Memory (LSTM), using hierarchical misalignment predictions on three resolutions of the image pair, leveraging the intrinsic strengths of an LSTM for this problem. The convolutional LSTM is trained on a set of artificially generated image pairs obtained from artificial displacement vector fields (DVFs). Results on chest CT scans show that incorporating multi-resolution information, and the hierarchical use via an LSTM for this, leads to overall better F1 scores, with fewer misclassifications in a well-tuned registration setup. The final system yields an accuracy of 87.1%, and an average F1 score of 66.4% aggregated in two independent chest CT scan studies. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|