Distance-based online pairs generation method for metric networks training

Autor: Alexander Sheshkus, Vladimir V. Arlazarov, Ivan V. Kondrashev
Rok vydání: 2021
Předmět:
Zdroj: Thirteenth International Conference on Machine Vision.
Popis: In this work, we consider the pairs generation algorithm based on the distances between elements in metric space. The right generation of training data is an actual issue, and its solution leads to better neural network learning. Understanding the properties of the source data, we can select pairs for training in such a way that the network will pay more attention to elements that are close in the metric space and have different classes. However, the problem arises when these properties are difficult to extract from the data and a more universal pairs generation method is needed. Our method generates pairs using the results of the network from previous iterations, in parallel with the training process itself. Thus, we do not need to evaluate the properties of elements ourselves, and we can use absolutely any data as learning objects. We demonstrate this approach using the example of Korean character recognition, and also compare it with other commonly used pair generation methods.
Databáze: OpenAIRE