Automatic image annotation based on an improved nearest neighbor technique with tag semantic extension model
| Autor: | Liu Wei, Qiong Wu, Yanduo Zhang, Luo Xu, Duan Gonghao, Wei Wei, Deng Chen |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
business.industry
Computer science Nearest neighbour algorithm ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 020206 networking & telecommunications Pattern recognition 02 engineering and technology Extension (predicate logic) Convolutional neural network k-nearest neighbors algorithm Image (mathematics) ComputingMethodologies_PATTERNRECOGNITION Automatic image annotation 0202 electrical engineering electronic engineering information engineering General Earth and Planetary Sciences 020201 artificial intelligence & image processing Artificial intelligence business General Environmental Science |
| Zdroj: | Procedia Computer Science. 183:616-623 |
| ISSN: | 1877-0509 |
| DOI: | 10.1016/j.procs.2021.02.105 |
| Popis: | Nearest Neighbor method (KNN) is a typical method to solve the problem of automatic image annotation (AIA). However, traditional AIA methods based on KNN only consider the relationships among images and labels. In this paper, we propose an improved KNN image annotation method based on a tag semantic extension model (TSEM). Our approach uses the convolutional neural network (CNN) to extract image features and predicts image tags automatically via nearest features. Different from existing work, the proposed method considers correlations among images, correlations between images and labels and those among labels. Additionally, a label quantity prediction (LQP) model is proposed to predict the number of tags, which further improves the tag prediction accuracy. Comparison experiments were performed on three typical image datasets Corel5k, ESP game and laprtc12. Experimental results show that the average F1 of our model is 0.427, which outperforms the state-of-the-art KNN image annotation methods. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|