Dual-supervised attention network for deep cross-modal hashing
| Autor: | Hanyu Peng, Yali Wang, Yu Qiao, Shifeng Chen, Junjun He |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Theoretical computer science
Computer science business.industry Deep learning Hash function 02 engineering and technology 01 natural sciences Dual (category theory) Task (project management) Artificial Intelligence 0103 physical sciences Signal Processing 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Binary code Computer Vision and Pattern Recognition Artificial intelligence 010306 general physics business Software Block (data storage) |
| Zdroj: | Pattern Recognition Letters. 128:333-339 |
| ISSN: | 0167-8655 |
| DOI: | 10.1016/j.patrec.2019.08.032 |
| Popis: | Cross-modal hashing has received intensive attention due to its low computation and storage efficiency in cross-modal retrieval task. Most previous cross-modal hashing methods mainly focus on extracting correlated binary codes from the pairwise label, but largely ignore the semantic categories of cross-modal data. On the other hand, human perception exploits category information to connect cross-modal samples. Inspired by this fact, we propose to embed category information into hash codes. More specifically, we introduce semantic prediction loss into our framework to enhance hash codes with category supervision. In addition, there always exists a large gap between features from different modalities (e.g. text and images), leading cross-modal hashing to link irrelevant features for retrieval task. To address this issue, this paper proposes Dual-Supervised Attention Network for Deep Hashing (DSADH) to learn the cross-modal relationship via an elaborately-designed attention mechanism. Our cross-modal network applies cross-modal attention block to efficiently encode rich and relevant features to learn compact hash codes. Extensive experiments on three challenging benchmarks demonstrate that our proposed method significantly improves the retrieval results. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect