DTCNet: Transformer-CNN Distillation for Super-Resolution of Remote Sensing Image
| Autor: | Cong Lin, Xin Mao, Chenghao Qiu, Lilan Zou |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2024 |
| Předmět: | |
| Zdroj: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol 17, Pp 11117-11133 (2024) |
| Druh dokumentu: | article |
| ISSN: | 1939-1404 2151-1535 |
| DOI: | 10.1109/JSTARS.2024.3409808 |
| Popis: | Super-resolution reconstruction technology is a crucial approach to enhance the quality of remote sensing optical images. Currently, the mainstream reconstruction methods leverage convolutional neural networks (CNNs). However, they overlook the global information of the images, thereby impacting the reconstruction effectiveness. Methods based on Transformer networks have demonstrated the capability to improve reconstruction quality, but the high model complexity renders them unsuitable for remote sensing devices. To enhance reconstruction performance while maintaining the model lightweight, a distillation Transform-CNN Network is proposed in this article. The strategy employs the Transformer network as a teacher network, guiding its long-range features into a compact CNN, achieving distillation across networks. Simultaneously, to rectify misinformation in the teacher network, prior information is introduced to ensure accurate information transfer. Concerning the student network, a novel upsampling approach is devised, utilizing inherent information in downsampled feature maps for padding, thereby avoiding the introduction of zero-information feature points in the traditional deconvolution process. Experimental evaluations conducted on multiple publicly available remote sensing image datasets demonstrate that the proposed method, while maintaining a smaller parameter count, achieves outstanding reconstruction quality for remote sensing images, surpassing existing approaches. |
| Databáze: | Directory of Open Access Journals |
| Externí odkaz: |
|