EVALUATION OF SELF-SUPERVISED LEARNING APPROACHES FOR SEMANTIC SEGMENTATION OF INDUSTRIAL BURNER FLAMES

Autor: S. Landgraf, L. Kühnlein, M. Hillemann, M. Hoyer, S. Keller, M. Ulrich
Jazyk: angličtina
Rok vydání: 2022
Předmět:
Zdroj: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol XLIII-B2-2022, Pp 601-607 (2022)
Druh dokumentu: article
ISSN: 1682-1750
2194-9034
DOI: 10.5194/isprs-archives-XLIII-B2-2022-601-2022
Popis: In recent years, self-supervised learning has made tremendous progress in closing the gap to supervised learning due to the rapid development of more sophisticated approaches like SimCLR, MoCo, and SwAV. However, these achievements are primarily evaluated on common benchmark datasets. In this paper, we focus on evaluating self-supervised learning for semantic segmentation of industrial burner flames. Our goal is to build an intuition on how self-supervision performs in a scenario relevant for industrial application where training labels and the opportunities for hyperparameter tuning are limited. We demonstrate that self-supervised pre-training can constitute an alternative to the state-of-the-art approach of pre-training on ImageNet. Across all scenarios, the self-supervised approaches are less susceptible to sub-optimal learning rates and achieve higher mean accuracies than ImageNet pre-training, especially when training labels are scarce.
Databáze: Directory of Open Access Journals