LowKeyEMG: Electromyographic typing with a reduced keyset
By: Johannes Y. Lee , Derek Xiao , Shreyas Kaasyap and more
Potential Business Impact:
Lets people type words with just a few hand movements.
We introduce LowKeyEMG, a real-time human-computer interface that enables efficient text entry using only 7 gesture classes decoded from surface electromyography (sEMG). Prior work has attempted full-alphabet decoding from sEMG, but decoding large character sets remains unreliable, especially for individuals with motor impairments. Instead, LowKeyEMG reduces the English alphabet to 4 gesture keys, with 3 more for space and system interaction, to reliably translate simple one-handed gestures into text, leveraging the recurrent transformer-based language model RWKV for efficient computation. In real-time experiments, participants achieved average one-handed keyboardless typing speeds of 23.3 words per minute with LowKeyEMG, and improved gesture efficiency by 17% (relative to typed phrase length). When typing with only 7 keys, LowKeyEMG can achieve 98.2% top-3 word accuracy, demonstrating that this low-key typing paradigm can maintain practical communication rates. Our results have implications for assistive technologies and any interface where input bandwidth is constrained.
Similar Papers
Typing Reinvented: Towards Hands-Free Input via sEMG
Human-Computer Interaction
Control computers with muscle movements for typing.
From Muscle to Text with MyoText: sEMG to Text via Finger Classification and Transformer-Based Decoding
Machine Learning (CS)
Lets you type words using only muscle movements.
Multimodal Appearance based Gaze-Controlled Virtual Keyboard with Synchronous Asynchronous Interaction for Low-Resource Settings
Human-Computer Interaction
Lets people type using just their eyes.