ETALON IMAGES: UNDERSTANDING THE CONVOLUTION NEURAL NETWORKS

Autor: V. V. Molchanov, B. V. Vishnyakov, V. S. Gorbatsevich, Y. V. Vizilter
Jazyk: angličtina
Rok vydání: 2018
Předmět:
Zdroj: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol XLII-2, Pp 707-714 (2018)
Druh dokumentu: article
ISSN: 1682-1750
2194-9034
DOI: 10.5194/isprs-archives-XLII-2-707-2018
Popis: In this paper we propose a new technic called etalons, which allows us to interpret the way how convolution network makes its predictions. This mechanism is very similar to voting among different experts. Thereby CNN could be interpreted as a variety of experts, but it acts not like a sum or product of them, but rather represent a complicated hierarchy. We implement algorithm for etalon acquisition based on well-known properties of affine maps. We show that neural net has two high-level mechanisms of voting: first, based on attention to input image regions, specific to current input, and second, based on ignoring specific input regions. We also make an assumption that there is a connection between complexity of the underlying data manifold and the number of etalon images and their quality.
Databáze: Directory of Open Access Journals