ASSESSING THE SEMANTIC SIMILARITY OF IMAGES OF SILK FABRICS USING CONVOLUTIONAL NEURAL NETWORKS
| Autor: | D. Clermont, M. Dorozynski, D. Wittich, F. Rottensteiner |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2020 |
| Předmět: | |
| Zdroj: | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol V-2-2020, Pp 641-648 (2020) |
| Druh dokumentu: | article |
| ISSN: | 2194-9042 2194-9050 |
| DOI: | 10.5194/isprs-annals-V-2-2020-641-2020 |
| Popis: | This paper proposes several methods for training a Convolutional Neural Network (CNN) for learning the similarity between images of silk fabrics based on multiple semantic properties of the fabrics. In the context of the EU H2020 project SILKNOW (http://silknow.eu/), two variants of training were developed, one based on a Siamese CNN and one based on a triplet architecture. We propose different definitions of similarity and different loss functions for both training strategies, some of them also allowing the use of incomplete information about the training data. We assess the quality of the trained model by using the learned image features in a k-NN classification. We achieve overall accuracies of 93–95% and average F1-scores of 87–92%. |
| Databáze: | Directory of Open Access Journals |
| Externí odkaz: |
|