Adaptive multi-degree of freedom Brain Computer Interface using online feedback: Towards novel methods and metrics of mutual adaptation between humans and machines for BCI
Autor: | George K. Karavas, Chuong H. Nguyen, Panagiotis Artemiadis |
---|---|
Rok vydání: | 2019 |
Předmět: |
Man-Computer Interface
Male Physiology Computer science Social Sciences 02 engineering and technology computer.software_genre Topology Machine Learning 0302 clinical medicine Mutual adaptation Medicine and Health Sciences 0202 electrical engineering electronic engineering information engineering Manifolds Clinical Neurophysiology Brain Mapping Multidisciplinary Covariance matrix Brain Electroencephalography Adaptation Physiological Multi degree of freedom Electrophysiology Bioassays and Physiological Analysis Brain Electrophysiology Brain-Computer Interfaces Physical Sciences Medicine Engineering and Technology Female 020201 artificial intelligence & image processing Research Article Adult Computer and Information Sciences Imaging Techniques Science Geometry Neurophysiology Neuroimaging Research and Analysis Methods Machine learning 03 medical and health sciences Artificial Intelligence Support Vector Machines Tangents Speech Humans Learning Brain–computer interface Relevance Vector Machines business.industry Electrophysiological Techniques Biology and Life Sciences Confusion matrix Linguistics Support vector machine Speech Signal Processing Human Factors Engineering Signal Processing Artificial intelligence Clinical Medicine business computer Classifier (UML) Mathematics 030217 neurology & neurosurgery Neuroscience |
Zdroj: | PLoS ONE PLoS ONE, Vol 14, Iss 3, p e0212620 (2019) |
ISSN: | 1932-6203 |
DOI: | 10.1371/journal.pone.0212620 |
Popis: | This paper proposes a novel adaptive online-feedback methodology for Brain Computer Interfaces (BCI). The method uses ElectroEncephaloGraphic (EEG) signals and combines motor with speech imagery to allow for tasks that involve multiple degrees of freedom (DoF). The main approach utilizes the covariance matrix descriptor as feature, and the Relevance Vector Machines (RVM) classifier. The novel contributions include, (1) a new method to select representative data to update the RVM model, and (2) an online classifier which is an adaptively-weighted mixture of RVM models to account for the users' exploration and exploitation processes during the learning phase. Instead of evaluating the subjects' performance solely based on the conventional metric of accuracy, we analyze their skill's improvement based on 3 other criteria, namely the confusion matrix's quality, the separability of the data, and their instability. After collecting calibration data for 8 minutes in the first run, 8 participants were able to control the system while receiving visual feedback in the subsequent runs. We observed significant improvement in all subjects, including two of them who fell into the BCI illiteracy category. Our proposed BCI system complements the existing approaches in several aspects. First, the co-adaptation paradigm not only adapts the classifiers, but also allows the users to actively discover their own way to use the BCI through their exploration and exploitation processes. Furthermore, the auto-calibrating system can be used immediately with a minimal calibration time. Finally, this is the first work to combine motor and speech imagery in an online feedback experiment to provide multiple DoF for BCI control applications. |
Databáze: | OpenAIRE |
Externí odkaz: |