Decoding speech information from EEG data with 4-, 7- and 11-month-old infants: Using convolutional neural network, mutual information-based and backward linear models

Autor: Mahmoud Keshavarzi, Áine Ní Choisdealbha, Adam Attaheri, Sinead Rocha, Perrine Brusini, Samuel Gibbon, Panagiotis Boutris, Natasha Mead, Helen Olawole-Scott, Henna Ahmed, Sheila A. Flanagan, Kanad Mandke, Usha Goswami
Rok vydání: 2021
DOI: 10.31234/osf.io/a6qfw
Popis: Background: Computational models that successfully decode neural activity into speech are multiplying in the adult literature, with convolutional neural networks (CNNs), backward linear models, and mutual information (MI) models all being applied to neural data in relation to speech input. This is not the case in the infant literature. New Method: Three different computational models, two novel for infants, were applied to decode low-frequency speech envelope information. Previously-employed backward linear models were compared to novel CNN and MI-based models. Fifty infants provided EEG recordings when aged 4, 7, and 11 months, while listening passively to natural speech (sung or chanted nursery rhymes) presented by video with a female singer. Results: Each model computed speech information for these nursery rhymes in two different low-frequency bands, delta (1 – 4 Hz) and theta (4 – 8 Hz), thought to provide different types of linguistic information. All three models demonstrated significant levels of performance for delta-band neural activity from 4 months of age, with two of three models also showing significant performance for theta-band activity. All models also demonstrated higher accuracy for the delta-band neural responses. None of the models showed developmental (age-related) effects. Comparisons with existing methods: The data demonstrate that the choice of algorithm used to decode speech envelope information from neural activity in the infant brain determines the developmental conclusions that can be drawn. Conclusions: Better understanding of the strengths and weaknesses of each modelling approach will be fundamental to improving our understanding of how the human brain builds a language system.
Databáze: OpenAIRE