Posterior Transition Modeling for Unsupervised Diffusion-Based Speech Enhancement
By: Mostafa Sadeghi , Jean-Eudes Ayilo , Romain Serizel and more
Potential Business Impact:
Cleans up noisy voices for clearer sound.
We explore unsupervised speech enhancement using diffusion models as expressive generative priors for clean speech. Existing approaches guide the reverse diffusion process using noisy speech through an approximate, noise-perturbed likelihood score, combined with the unconditional score via a trade-off hyperparameter. In this work, we propose two alternative algorithms that directly model the conditional reverse transition distribution of diffusion states. The first method integrates the diffusion prior with the observation model in a principled way, removing the need for hyperparameter tuning. The second defines a diffusion process over the noisy speech itself, yielding a fully tractable and exact likelihood score. Experiments on the WSJ0-QUT and VoiceBank-DEMAND datasets demonstrate improved enhancement metrics and greater robustness to domain shifts compared to both supervised and unsupervised baselines.
Similar Papers
Diffusion-Based Unsupervised Audio-Visual Speech Separation in Noisy Environments with Noise Prior
Audio and Speech Processing
Cleans up noisy audio to hear voices better.
Diffusion models for multivariate subsurface generation and efficient probabilistic inversion
CV and Pattern Recognition
Maps underground rock layers faster and better.
Distributional Diffusion Models with Scoring Rules
Machine Learning (CS)
Makes AI create pictures much faster.