An instantaneous voice synthesis neuroprosthesis.

Autor:	Wairagkar M; Department of Neurological Surgery, University of California Davis, Davis, CA., Card NS; Department of Neurological Surgery, University of California Davis, Davis, CA., Singer-Clark T; Department of Neurological Surgery, University of California Davis, Davis, CA.; Department of Biomedical Engineering, University of California Davis, Davis, CA., Hou X; Department of Neurological Surgery, University of California Davis, Davis, CA.; Department of Computer Science, University of California Davis, Davis, CA., Iacobacci C; Department of Neurological Surgery, University of California Davis, Davis, CA., Hochberg LR; School of Engineering and Carney Institute for Brain Sciences, Brown University, Providence, RI.; VA RR&D Center for Neurorestoration and Neurotechnology, VA Providence Healthcare, Providence, RI.; Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA., Brandman DM; Department of Neurological Surgery, University of California Davis, Davis, CA., Stavisky SD; Department of Neurological Surgery, University of California Davis, Davis, CA.
Jazyk:	angličtina
Zdroj:	BioRxiv : the preprint server for biology [bioRxiv] 2024 Sep 20. Date of Electronic Publication: 2024 Sep 20.
DOI:	10.1101/2024.08.14.607690
Abstrakt:	Brain computer interfaces (BCIs) have the potential to restore communication to people who have lost the ability to speak due to neurological disease or injury. BCIs have been used to translate the neural correlates of attempted speech into text 1-3 . However, text communication fails to capture the nuances of human speech such as prosody, intonation and immediately hearing one's own voice. Here, we demonstrate a "brain-to-voice" neuroprosthesis that instantaneously synthesizes voice with closed-loop audio feedback by decoding neural activity from 256 microelectrodes implanted into the ventral precentral gyrus of a man with amyotrophic lateral sclerosis and severe dysarthria. We overcame the challenge of lacking ground-truth speech for training the neural decoder and were able to accurately synthesize his voice. Along with phonemic content, we were also able to decode paralinguistic features from intracortical activity, enabling the participant to modulate his BCI-synthesized voice in real-time to change intonation, emphasize words, and sing short melodies. These results demonstrate the feasibility of enabling people with paralysis to speak intelligibly and expressively through a BCI. Competing Interests: Competing Interests: Stavisky is an inventor on intellectual property owned by Stanford University that has been licensed to Blackrock Neurotech and Neuralink Corp. Wairagkar, Stavisky, and Brandman have patent applications related to speech BCI owned by the Regents of the University of California. Brandman is a surgical consultant to Paradromics Inc. Stavisky is a scientific advisor to Sonera and ALVI Labs. The MGH Translational Research Center has a clinical research support agreement with Neuralink, Synchron, Axoft, Precision Neuro, and Reach Neuro, for which Hochberg provides consultative input. Mass General Brigham (MGB) is convening the Implantable Brain-Computer Interface Collaborative Community (iBCI-CC); charitable gift agreements to MGB, including those received to date from Paradromics, Synchron, Precision Neuro, Neuralink, and Blackrock Neurotech, support the iBCI-CC, for which Hochberg provides effort.
Databáze:	MEDLINE
Externí odkaz:	Zobrazit plný text záznamu