Dynamically Modulated Deep Metric Learning for Visual Search
| Autor: | Kim-Hui Yap, Dipu Manandhar, Muhammet Bastan |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
Visual search
business.industry Computer science Deviance (statistics) 02 engineering and technology Machine learning computer.software_genre 030218 nuclear medicine & medical imaging 03 medical and health sciences 0302 clinical medicine 0202 electrical engineering electronic engineering information engineering Embedding 020201 artificial intelligence & image processing Artificial intelligence business computer |
| Zdroj: | ICASSP |
| Popis: | This paper proposes dynamically modulated metric learning (DMML) for learning a tiered similarity space to perform visual search. Existing methods often treat the training samples having different degree of information with equal importance which hinders in capturing the underlying granularities in visual similarity. Proposed DMML automatically exploits the informativeness of samples during training by leveraging correlation between image attributes and embedding that are learned jointly. The two tasks are interlinked by supervising signals where the predicted attribute vectors are used to dynamically learn the loss function. To this end, we propose a new soft-binomial deviance loss that helps to capture the feature similarity space at multiple granularities. Compared to recent ensemble and attention based methods, our DMML framework is conceptually simple yet effective, and achieves state-of-the-art performances on standard benchmark datasets; e.g. an improvement of 4% Recall@1 over the SOTA [1] on DeepFashion dataset. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|