Co-Designing Multimodal Systems for Accessible Remote Dance Instruction
By: Ujjaini Das , Shreya Kappala , Meng Chen and more
Potential Business Impact:
Helps blind dancers learn moves using sound and touch.
Videos make exercise instruction widely available, but they rely on visual demonstrations that blind and low vision (BLV) learners cannot see. While audio descriptions (AD) can make videos accessible, describing movements remains challenging as the AD must convey what to do (mechanics, location, orientation) and how to do it (speed, fluidity, timing). Prior work thus used multimodal instruction to support BLV learners with individual simple movements. However, it is unclear how these approaches scale to dance instruction with unique, complex movements and precise timing constraints. To inform accessible remote dance instruction systems, we conducted three co-design workshops (N=28) with BLV dancers, instructors, and experts in sound, haptics, and AD. Participants designed 8 systems revealing common themes: staged learning to dissect routines, crafting vocabularies for movements, and selectively using modalities (narration for movement structure, sound for expression, and haptics for spatial cues). We conclude with design recommendations to make learning dance accessible.
Similar Papers
Co-Designing Multimodal Systems for Accessible Remote Dance Instruction
Human-Computer Interaction
Helps blind dancers learn moves with sound and touch.
Sensing Movement: Contemporary Dance Workshops with People who are Blind or have Low Vision and Dance Teachers
Human-Computer Interaction
Helps blind dancers learn and create movement.
Accessibility and Social Inclusivity: A Literature Review of Music Technology for Blind and Low Vision People
Human-Computer Interaction
Helps blind people make and enjoy music.