Design Probes for AI-Driven AAC: Addressing Complex Communication Needs in Aphasia
By: Lei Mao , Jong Ho Lee , Yasmeen Faroqi Shah and more
Potential Business Impact:
Helps people with speech problems talk better.
AI offers key advantages such as instant generation, multi-modal support, and personalized adaptability - potential that can address the highly heterogeneous communication barriers faced by people with aphasia (PWAs). We designed AI-enhanced communication tools and used them as design probes to explore how AI's real-time processing and generation capabilities - across text, image, and audio - can align with PWAs' needs in real-time communication and preparation for future conversations respectively. Through a two-phase "Research through Design" approach, eleven PWAs contributed design insights and evaluated four AI-enhanced prototypes. These prototypes aimed to improve communication grounding and conversational agency through visual verification, grammar construction support, error correction, and reduced language processing load. Despite some challenges, such as occasional mismatches with user intent, findings demonstrate how AI's specific capabilities can be advantageous in addressing PWAs' complex needs. Our work contributes design insights for future Augmentative and Alternative Communication (AAC) systems.
Similar Papers
ImageTalk: Designing a Multimodal AAC Text Generation System Driven by Image Recognition and Natural Language Generation
Human-Computer Interaction
Helps people with speech problems talk faster.
AI-Powered Assistive Technologies for Visual Impairment
Human-Computer Interaction
Helps blind people understand the world around them.
DescribePro: Collaborative Audio Description with Human-AI Interaction
Human-Computer Interaction
Helps make audio descriptions for movies better.