Energy-Based Supervised Hashing for Multimorbidity Image Retrieval

Autor: Guodong Guo, Peng Huang, Xiuzhuang Zhou, Zeqiang Wei
Rok vydání: 2021
Předmět:
Zdroj: Medical Image Computing and Computer Assisted Intervention – MICCAI 2021 ISBN: 9783030872397
MICCAI (5)
DOI: 10.1007/978-3-030-87240-3_20
Popis: Content-based image retrieval (CBIR) has attracted increasing attention in the field of computer-aided diagnosis, for which learning-based hashing approaches represent the most prominent techniques for large-scale image retrieval. In this work, we propose a Supervised Hashing method with Energy-Based Modeling (SH-EBM) for scalable multi-label image retrieval, where concurrence of multiple symptoms with subtle differences in visual feature makes the search problem quite challenging, even for sophisticated hashing models built upon modern deep architectures. In addition to similarity-preserving ranking loss, multi-label classification loss is often employed in existing supervised hashing to further improve the expressiveness of hash codes, by optimizing a normalized probabilistic objective with tractable likelihood (e.g., multi-label cross-entropy). On the contrary, we present a multi-label EBM loss without restriction on the tractability of the log-likelihood, which is more flexible to parameterize and can model a more expressive probability distribution over multimorbidity image data. We further develop a multi-label Noise Contrastive Estimation (ml-NCE) algorithm for discriminative training of the proposed hashing network. On a multimorbidity dataset constructed by the NIH Chest X-ray, our SH-EBM outperforms most supervised hashing methods by a significant margin, implying its effectiveness in facilitating multilevel similarity preservation for scalable image retrieval.
Databáze: OpenAIRE