TDCMR: Triplet-Based Deep Cross-Modal Retrieval for Geo-Multimedia Data

Autor: Jiagang Song, Yunwu Lin, Jiayu Song, Weiren Yu, Leyuan Zhang
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: Applied Sciences, Vol 11, Iss 22, p 10803 (2021)
Druh dokumentu: article
ISSN: 2076-3417
DOI: 10.3390/app112210803
Popis: Mass multimedia data with geographical information (geo-multimedia) are collected and stored on the Internet due to the wide application of location-based services (LBS). How to find the high-level semantic relationship between geo-multimedia data and construct efficient index is crucial for large-scale geo-multimedia retrieval. To combat this challenge, the paper proposes a deep cross-modal hashing framework for geo-multimedia retrieval, termed as Triplet-based Deep Cross-Modal Retrieval (TDCMR), which utilizes deep neural network and an enhanced triplet constraint to capture high-level semantics. Besides, a novel hybrid index, called TH-Quadtree, is developed by combining cross-modal binary hash codes and quadtree to support high-performance search. Extensive experiments are conducted on three common used benchmarks, and the results show the superior performance of the proposed method.
Databáze: Directory of Open Access Journals