PDAF: Prompt-Driven Dynamic Adaptive Fusion Network for Pansharpening Remote Sensing Images
| Autor: | Hailin Tao, Genji Yuan, Zhen Hua, Jinjiang Li |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2024 |
| Předmět: | |
| Zdroj: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol 17, Pp 13533-13546 (2024) |
| Druh dokumentu: | article |
| ISSN: | 1939-1404 2151-1535 |
| DOI: | 10.1109/JSTARS.2024.3433597 |
| Popis: | The goal of pansharpening is to fuse a high spatial resolution panchromatic (PAN) image with a lower spatial resolution multispectral (MS) image to produce a high-resolution multispectral image. Most deep learning-based methods consider only local or global features, and focusing solely on one type of feature may limit the network's representational capacity. In addition, the fusion process often overlooks the heterogeneous and complementary information unique to PAN and MS images. Therefore, we propose a prompt-driven dynamic adaptive fusion network. To better combine the advantages of local and global features, we introduce a local and global adaptive modulation module. We also innovatively propose a prompt-driven dynamic fusion module that effectively integrates unique heterogeneous information while reconstructing corresponding complementary information. Finally, an expert mixing mechanism is employed to enhance the fused features, achieving superior fusion results. Our proposed method outperforms recent pansharpening methods, as demonstrated by reduced-resolution experiments and full-resolution validation. |
| Databáze: | Directory of Open Access Journals |
| Externí odkaz: |
|