A Deep Learning Approach for Human Activities Recognition From Multimodal Sensing Devices
Autor: | Kayode Owa, Augustine O. Nwajana, Isibor Kennedy Ihianle, Solomon H. Ebenuwa, Mobolaji O. Orisatoki, Richard I. Otuka |
---|---|
Rok vydání: | 2020 |
Předmět: |
General Computer Science
Computer science Feature extraction convolutional neural network 02 engineering and technology Machine learning computer.software_genre Convolutional neural network Activity recognition 020204 information systems 0202 electrical engineering electronic engineering information engineering General Materials Science Representation (mathematics) Hidden Markov model Modality (human–computer interaction) Heuristic business.industry wearable sensors Deep learning General Engineering deep learning machine learning TA 020201 artificial intelligence & image processing Human activity recognition lcsh:Electrical engineering. Electronics. Nuclear engineering Artificial intelligence long short-term memory business lcsh:TK1-9971 computer |
Zdroj: | IEEE Access, Vol 8, Pp 179028-179038 (2020) IEEE Access |
ISSN: | 2169-3536 |
DOI: | 10.1109/access.2020.3027979 |
Popis: | Research in the recognition of human activities of daily living has significantly improved using deep learning techniques. Traditional human activity recognition techniques often use handcrafted features from heuristic processes from single sensing modality. The development of deep learning techniques has addressed most of these problems by the automatic feature extraction from multimodal sensing devices to recognise activities accurately. In this paper, we propose a deep learning multi-channel architecture using a combination of convolutional neural network (CNN) and Bidirectional long short-term memory (BLSTM). The advantage of this model is that the CNN layers perform direct mapping and abstract representation of raw sensor inputs for feature extraction at different resolutions. The BLSTM layer takes full advantage of the forward and backward sequences to improve the extracted features for activity recognition significantly. We evaluate the proposed model on two publicly available datasets. The experimental results show that the proposed model performed considerably better than our baseline models and other models using the same datasets. It also demonstrates the suitability of the proposed model on multimodal sensing devices for enhanced human activity recognition. |
Databáze: | OpenAIRE |
Externí odkaz: |