Improved Activity Recognition Combining Inertial Motion Sensors and Electroencephalogram Signals
| Autor: | Marina Aguilar-Moreno, Javier de Lope Asiain, Manuel Graña, Ibai Baglietto Araquistain, Xavier Garmendia |
|---|---|
| Přispěvatelé: | European Commission |
| Jazyk: | angličtina |
| Rok vydání: | 2020 |
| Předmět: |
Adult
Computer Networks and Communications Computer science Monitoring Ambulatory Walking system Activity recognition Machine Learning 03 medical and health sciences 0302 clinical medicine Moving average Inertial measurement unit Accelerometry Humans Human Activities activity recognition EEG 030304 developmental biology 0303 health sciences Sitting Position inertial measurement accuracy business.industry neuroethology Experimental data Pattern recognition Electroencephalography General Medicine tracking Sensor fusion field Random forest Standing Position Artificial intelligence business Transfer of learning 030217 neurology & neurosurgery Smoothing |
| Zdroj: | Addi. Archivo Digital para la Docencia y la Investigación instname Addi: Archivo Digital para la Docencia y la Investigación Universidad del País Vasco |
| Popis: | Human activity recognition and neural activity analysis are the basis for human computational neureoethology research dealing with the simultaneous analysis of behavioral ethogram descriptions and neural activity measurements. Wireless electroencephalography (EEG) and wireless inertial measurement units (IMU) allow the realization of experimental data recording with improved ecological validity where the subjects can be carrying out natural activities while data recording is minimally invasive. Specifically, we aim to show that EEG and IMU data fusion allows improved human activity recognition in a natural setting. We have defined an experimental protocol composed of natural sitting, standing and walking activities, and we have recruited subjects in two sites: in-house (N = 4) and out-house (N = 12) populations with different demographics. Experimental protocol data capture was carried out with validated commercial systems. Classifier model training and validation were carried out with scikit-learn open source machine learning python package. EEG features consist of the amplitude of the standard EEG frequency bands. Inertial features were the instantaneous position of the body tracked points after a moving average smoothing to remove noise. We carry out three validation processes: a 10-fold cross-validation process per experimental protocol repetition, (b) the inference of the ethograms, and (c) the transfer learning from each experimental protocol repetition to the remaining repetitions. The in-house accuracy results were lower and much more variable than the out-house sessions results. In general, random forest was the best performing classifier model. Best cross-validation results, ethogram accuracy, and transfer learning were achieved from the fusion of EEG and IMUs data. Transfer learning behaved poorly compared to classification on the same protocol repetition, but it has accuracy still greater than 0.75 on average for the out-house data sessions. Transfer leaning accuracy among repetitions of the same subject was above 0.88 on average. Ethogram prediction accuracy was above 0.96 on average. Therefore, we conclude that wireless EEG and IMUs allow for the definition of natural experimental designs with high ecological validity toward human computational neuroethology research. The fusion of both EEG and IMUs signals improves activity and ethogram recognition This work has been partially supported by FEDER funds through MINECO Project TIN2017-85827-P. Special thanks to Naiara Vidal from IMH who conducted the recruitment process in the framework of Langileok project funded by the Elkartek program. This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No. 777720. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|