Low-Rank Nonlocal Representation for Remote Sensing Scene Classification
| Autor: | Longwei Li, Linming Gao, Nan Li |
|---|---|
| Rok vydání: | 2022 |
| Předmět: |
Boosting (machine learning)
Rank (linear algebra) Hierarchy (mathematics) Dimension (vector space) Computer science Computation Feature (machine learning) Electrical and Electronic Engineering Geotechnical Engineering and Engineering Geology Representation (mathematics) Convolutional neural network Residual neural network Remote sensing |
| Zdroj: | IEEE Geoscience and Remote Sensing Letters. 19:1-5 |
| ISSN: | 1558-0571 1545-598X |
| DOI: | 10.1109/lgrs.2021.3049251 |
| Popis: | The nonlocal mechanism (NM) has shown its effectiveness in many real-world applications. However, it is usually criticized for its costly computation complexity in time and space, which are both O(H²W²), where Hx W is the spatial dimension of input feature maps in height and width. In this letter, we first show that the NM can be expressed as a low-rank representation by theory. Then we propose a down-to-earth low-complexity global context acquisition mechanism, termed as the low-rank nonlocal representation (LNR), whose complexity in time and space are both approximatively O(HW). LNR is a general module that can be deployed on an arbitrary convolutional neural network (CNN) hierarchy for any visual recognition tasks. To demonstrate its superiority, experiments are carried out on four standard remote sensing scene classification benchmarks. Experimental results show that our proposed LNR can significantly reduce the computation cost by boosting the performance gain. Implementing LNR on the classical ResNet, in particular, can reduce at most 3.93 M model parameters. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|