An Approach for Multimodal Medical Image Retrieval using Latent Dirichlet Allocation
| Autor: | S Sowmya Kamath, Suhas Bs, Aditya Anantharaman, Mandikal Vikram |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Topic model
Information retrieval Modalities genetic structures Computer science business.industry 02 engineering and technology Health informatics Latent Dirichlet allocation 030218 nuclear medicine & medical imaging 03 medical and health sciences symbols.namesake 0302 clinical medicine 0202 electrical engineering electronic engineering information engineering Medical imaging symbols Leverage (statistics) 020201 artificial intelligence & image processing Medical diagnosis business Image retrieval |
| Zdroj: | COMAD/CODS |
| DOI: | 10.1145/3297001.3297007 |
| Popis: | Modern medical practices are increasingly dependent on Medical Imaging for clinical analysis and diagnoses of patient illnesses. A significant challenge when dealing with the extensively available medical data is that it often consists of heterogeneous modalities. Existing works in the field of Content based medical image retrieval (CBMIR) have several limitations as they focus mainly on visual or textual features for retrieval. Given the unique manifold of medical data, we seek to leverage both the visual and textual modalities to improve the image retrieval. We propose a Latent Dirichlet Allocation (LDA) based technique for encoding the visual features and show that these features effectively model the medical images. We explore early fusion and late fusion techniques to combine these visual features with the textual features. The proposed late fusion technique achieved a higher mAP than the state-of-the-art on the ImageCLEF 2009 dataset, underscoring its suitability for effective multimodal medical image retrieval. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|