Land Cover Classification of UAV Remote Sensing Based on Transformer–CNN Hybrid Architecture

Autor: Tingyu Lu, Luhe Wan, Shaoqun Qi, Meixiang Gao
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Zdroj: Sensors, Vol 23, Iss 11, p 5288 (2023)
Druh dokumentu: article
ISSN: 1424-8220
DOI: 10.3390/s23115288
Popis: High-precision land cover maps of remote sensing images based on an intelligent extraction method are an important research field for many scholars. In recent years, deep learning represented by convolutional neural networks has been introduced into the field of land cover remote sensing mapping. In view of the problem that a convolution operation is good at extracting local features but has limitations in modeling long-distance dependence relationships, a semantic segmentation network, DE-UNet, with a dual encoder is proposed in this paper. The Swin Transformer and convolutional neural network are used to design the hybrid architecture. The Swin Transformer pays attention to multi-scale global features and learns local features through the convolutional neural network. Integrated features take into account both global and local context information. In the experiment, remote sensing images from UAVs were used to test three deep learning models including DE-UNet. DE-UNet achieved the highest classification accuracy, and the average overall accuracy was 0.28% and 4.81% higher than UNet and UNet++, respectively. It shows that the introduction of a Transformer enhances the model fitting ability.
Databáze: Directory of Open Access Journals
Nepřihlášeným uživatelům se plný text nezobrazuje