An End-to-End Network for Continuous Human Motion Recognition via Radar Radios
Autor: | Jian Liu, Xinhua Liu, Running Zhao, Xiaolin Ma |
---|---|
Rok vydání: | 2021 |
Předmět: |
Computer science
010401 analytical chemistry Feature extraction computer.software_genre 01 natural sciences 0104 chemical sciences law.invention Recurrent neural network End-to-end principle law Spectrogram Data mining Electrical and Electronic Engineering Radar Representation (mathematics) Instrumentation computer |
Zdroj: | IEEE Sensors Journal. 21:6487-6496 |
ISSN: | 2379-9153 1530-437X |
Popis: | Micro-Doppler-based continuous human motion recognition (HMR) has gained considerable attention recently. However, existing methods mainly rely on individual recurrent neural network or sliding-window-based approaches, which makes them hard to effectively exploit all the temporal information to predict motions. Additionally, they need to represent the raw radar data into other domains and then perform feature extraction and classification. Thus, the representation cannot be optimized, and its high computational complexity and independence from learning model make the network consume significant time. In this article, to address these issues, we propose a new end-to-end network that uses radar radios to recognize continuous motion. Specifically, the fusion layer fuses the raw I & Q radar data without the need of representations, and it is integrated with subsequent networks in an end-to-end manner for jointly optimization. Moreover, the attention-based encoder-decoder structure encodes the fused data and selects useful temporal information for recognition, which guarantees the effective use of all the temporal information. The experiments show that in continuous HMR, the proposed network outperforms existing methods in terms of accuracy and inference time. |
Databáze: | OpenAIRE |
Externí odkaz: |