Wireless Silent Speech Interface Using Multi-Channel Textile EMG Sensors Integrated into Headphones
By: Chenyu Tang , Josée Mallah , Dominika Kazieczko and more
Potential Business Impact:
Lets you talk to computers without making noise.
This paper presents a novel wireless silent speech interface (SSI) integrating multi-channel textile-based EMG electrodes into headphone earmuff for real-time, hands-free communication. Unlike conventional patch-based EMG systems, which require large-area electrodes on the face or neck, our approach ensures comfort, discretion, and wearability while maintaining robust silent speech decoding. The system utilizes four graphene/PEDOT:PSS-coated textile electrodes to capture speech-related neuromuscular activity, with signals processed via a compact ESP32-S3-based wireless readout module. To address the challenge of variable skin-electrode coupling, we propose a 1D SE-ResNet architecture incorporating squeeze-and-excitation (SE) blocks to dynamically adjust per-channel attention weights, enhancing robustness against motion-induced impedance variations. The proposed system achieves 96% accuracy on 10 commonly used voice-free control words, outperforming conventional single-channel and non-adaptive baselines. Experimental validation, including XAI-based attention analysis and t-SNE feature visualization, confirms the adaptive channel selection capability and effective feature extraction of the model. This work advances wearable EMG-based SSIs, demonstrating a scalable, low-power, and user-friendly platform for silent communication, assistive technologies, and human-computer interaction.
Similar Papers
A Parallel Ultra-Low Power Silent Speech Interface based on a Wearable, Fully-dry EMG Neckband
Systems and Control
Lets you talk to computers without making noise.
A Silent Speech Decoding System from EEG and EMG with Heterogenous Electrode Configurations
Quantitative Methods
Lets people talk with their minds.
Typing Reinvented: Towards Hands-Free Input via sEMG
Human-Computer Interaction
Control computers with muscle movements for typing.