Causal Structure Discovery for Error Diagnostics of Children's ASR
By: Vishwanath Pratap Singh, Md. Sahidullah, Tomi Kinnunen
Potential Business Impact:
Makes computers understand kids' voices better.
Children's automatic speech recognition (ASR) often underperforms compared to that of adults due to a confluence of interdependent factors: physiological (e.g., smaller vocal tracts), cognitive (e.g., underdeveloped pronunciation), and extrinsic (e.g., vocabulary limitations, background noise). Existing analysis methods examine the impact of these factors in isolation, neglecting interdependencies-such as age affecting ASR accuracy both directly and indirectly via pronunciation skills. In this paper, we introduce a causal structure discovery to unravel these interdependent relationships among physiology, cognition, extrinsic factors, and ASR errors. Then, we employ causal quantification to measure each factor's impact on children's ASR. We extend the analysis to fine-tuned models to identify which factors are mitigated by fine-tuning and which remain largely unaffected. Experiments on Whisper and Wav2Vec2.0 demonstrate the generalizability of our findings across different ASR systems.
Similar Papers
Variational Low-Rank Adaptation for Personalized Impaired Speech Recognition
Audio and Speech Processing
Helps computers understand speech with problems.
Exploring Generative Error Correction for Dysarthric Speech Recognition
Computation and Language
Helps computers understand speech from people with speech problems.
Classification errors distort findings in automated speech processing: examples and solutions from child-development research
Machine Learning (CS)
Fixes computer mistakes when studying kids' talk.