Private and common feature learning with adversarial network for RGBD object classification
| Autor: | Wuji Liu, Han Pan, Zhongliang Jing, Lingfeng Qiao, Henry Leung |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
0209 industrial biotechnology
Adversarial network Computer science business.industry Cognitive Neuroscience Pattern recognition 02 engineering and technology Unimodality Computer Science Applications 020901 industrial engineering & automation Artificial Intelligence Robustness (computer science) 0202 electrical engineering electronic engineering information engineering RGB color model 020201 artificial intelligence & image processing Artificial intelligence business Encoder Feature learning |
| Zdroj: | Neurocomputing. 423:190-199 |
| ISSN: | 0925-2312 |
| DOI: | 10.1016/j.neucom.2020.07.129 |
| Popis: | A key issue in RGBD classification is how to fuse the RGB and depth modalities. A popular way is to extract the private features of unimodality and the common features between the two modalities. Most of them use low order algebraic metrics to find the common part of the RGB and depth signals. In this paper, adversarial network is used to learn the common features between the RGB and depth modalities. A modality discriminator is designed to compete with the feature encoder so as to generate the modality-invariant information, which can be regarded as the common features. With this concept, we present a Multi-Modal Feature Learning algorithm with Adversarial Network (MMFLAN) to decouple the RGBD signals and obtain the fused features. Comprehensive experiments based on three datasets are used to evaluate the effectiveness and robustness of our MMFLAN. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect