MeloKids: Multisensory VR System to Enhance Speech and Motor Coordination in Children with Hearing Loss
By: Yichen Yu, Qiaoran Wang
Potential Business Impact:
Helps deaf kids learn to talk better with games.
Children with hearing impairments face ongoing challenges in language and motor development. This study explores how multi-sensory feedback technology based on virtual reality (VR), integrating auditory, visual, and tactile stimuli, can enhance rehabilitation outcomes. Using functional near-infrared spectroscopy (fNIRS) technology, we assessed cortical activation patterns in children during pitch-matching tasks across different interaction modes. Our findings aim to provide evidence for designing personalized, interactive rehabilitation systems that enhance cognitive engagement and motor control in children with hearing impairments.
Similar Papers
Real-Time Auralization for First-Person Vocal Interaction in Immersive Virtual Environments
Audio and Speech Processing
Makes virtual reality sound like real places.
Beyond the Portal: Enhancing Recognition in Virtual Reality Through Multisensory Cues
Human-Computer Interaction
Adds sound and smell to VR for better games.
Virtual Reality in Sign Language Education: Opportunities, Challenges, and the Road Ahead
Human-Computer Interaction
Teaches sign language with virtual reality and AI.