JUNGLE-NET: USING EXPLAINABLE MACHINE LEARNING TO GAIN NEW INSIGHTS INTO THE APPEARANCE OF WILDERNESS IN SATELLITE IMAGERY

Autor: T. Stomberg, I. Weber, M. Schmitt, R. Roscher
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol V-3-2021, Pp 317-324 (2021)
Druh dokumentu: article
ISSN: 2194-9042
2194-9050
DOI: 10.5194/isprs-annals-V-3-2021-317-2021
Popis: Explainable machine learning has recently gained attention due to its contribution to understanding how a model works and why certain decisions are made. A so far less targeted goal, especially in remote sensing, is the derivation of new knowledge and scientific insights from observational data. In our paper, we propose an explainable machine learning approach to address the challenge that certain land cover classes such as wilderness are not well-defined in satellite imagery and can only be used with vague labels for mapping. Our approach consists of a combined U-Net and ResNet-18 that can perform scene classification while providing at the same time interpretable information with which we can derive new insights about classes. We show that our methodology allows us to deepen our understanding of what makes nature wild by automatically identifying simple concepts such as wasteland that semantically describes wilderness. It further quantifies a class’s sensitivity with respect to a concept and uses it as an indicator for how well a concept describes the class.
Databáze: Directory of Open Access Journals