Performance Modeling for Correlation-based Neural Decoding of Auditory Attention to Speech
By: Simon Geirnaert , Jonas Vanthornhout , Tom Francart and more
Potential Business Impact:
Helps hearing aids focus on who you're listening to.
Correlation-based auditory attention decoding (AAD) algorithms exploit neural tracking mechanisms to determine listener attention among competing speech sources via, e.g., electroencephalography signals. The correlation coefficients between the decoded neural responses and encoded speech stimuli of the different speakers then serve as AAD decision variables. A critical trade-off exists between the temporal resolution (the decision window length used to compute these correlations) and the AAD accuracy. This trade-off is typically characterized by evaluating AAD accuracy across multiple window lengths, leading to the performance curve. We propose a novel method to model this trade-off curve using labeled correlations from only a single decision window length. Our approach models the (un)attended correlations with a normal distribution after applying the Fisher transformation, enabling accurate AAD accuracy prediction across different window lengths. We validate the method on two distinct AAD implementations: a linear decoder and the non-linear VLAAI deep neural network, evaluated on separate datasets. Results show consistently low modeling errors of approximately 2 percent points, with 94% of true accuracies falling within estimated 95%-confidence intervals. The proposed method enables efficient performance curve modeling without extensive multi-window length evaluation, facilitating practical applications in, e.g., performance tracking in neuro-steered hearing devices to continuously adapt the system parameters over time.
Similar Papers
Unsupervised EEG-based decoding of absolute auditory attention with canonical correlation analysis
Signal Processing
Lets computers tell if you're really listening.
Reducing Object Hallucination in Large Audio-Language Models via Audio-Aware Decoding
Audio and Speech Processing
Stops AI from making up sounds it hears.
Efficient Solutions for Mitigating Initialization Bias in Unsupervised Self-Adaptive Auditory Attention Decoding
Signal Processing
Helps hearing aids focus on one voice.