Investigating static and sequential models for intervention-free selection using multimodal data of EEG and eye tracking
| Autor: | Mazen Salous, Jutta Hild, Tanja Schultz, Jürgen Beyerer, Felix Putze |
|---|---|
| Rok vydání: | 2018 |
| Předmět: |
Recall
business.industry Computer science 05 social sciences 020207 software engineering Cognition 02 engineering and technology Machine learning computer.software_genre 050105 experimental psychology Support vector machine Task (computing) 0202 electrical engineering electronic engineering information engineering False positive paradox Eye tracking 0501 psychology and cognitive sciences Artificial intelligence Sequential model business computer Selection (genetic algorithm) |
| Zdroj: | MCPMD@ICMI |
| DOI: | 10.1145/3279810.3279841 |
| Popis: | Multimodal data is increasingly used in cognitive prediction models to better analyze and predict different user cognitive processes. Classifiers based on such data, however, have different performance characteristics. We discuss in this paper an intervention-free selection task using multimodal data of EEG and eye tracking in three different models. We show that a sequential model, LSTM, is more sensitive but less precise than a static model SVM. Moreover, we introduce a confidence-based Competition-Fusion model using both SVM and LSTM. The fusion model further improves the recall compared to either SVM or LSTM alone, without decreasing precision compared to LSTM. According to the results, we recommend SVM for interactive applications which require minimal false positives (high precision), and recommend LSTM and highly recommend Competition-Fusion Model for applications which handle intervention-free selection requests in an additional post-processing step, requiring higher recall than precision. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|