Magnetoencephalography (MEG) Based Non-Invasive Chinese Speech Decoding
By: Zhihong Jia , Hongbin Wang , Yuanzhong Shen and more
Potential Business Impact:
Lets people talk using brain signals.
As an emerging paradigm of brain-computer interfaces (BCIs), speech BCI has the potential to directly reflect auditory perception and thoughts, offering a promising communication alternative for patients with aphasia. Chinese is one of the most widely spoken languages in the world, whereas there is very limited research on speech BCIs for Chinese language. This paper reports a text-magnetoencephalography (MEG) dataset for non-invasive Chinese speech BCIs. It also proposes a multi-modality assisted speech decoding (MASD) algorithm to capture both text and acoustic information embedded in brain signals during speech activities. Experiment results demonstrated the effectiveness of both our text-MEG dataset and our proposed MASD algorithm. To our knowledge, this is the first study on modality-assisted decoding for non-invasive speech BCIs.
Similar Papers
A Pre-trained Framework for Multilingual Brain Decoding Using Non-invasive Recordings
Neurons and Cognition
Lets brains talk in any language.
CAT-Net: A Cross-Attention Tone Network for Cross-Subject EEG-EMG Fusion Tone Decoding
Sound
Lets people "talk" with their minds by reading brain and muscle signals.
A Robust Multi-Scale Framework with Test-Time Adaptation for sEEG-Based Speech Decoding
Human-Computer Interaction
Lets paralyzed people talk by reading brain waves.