Is Phase Really Needed for Weakly-Supervised Dereverberation ?
By: Marius Rodrigues , Louis Bahrman , Roland Badeau and more
Potential Business Impact:
Cleans up echo in recordings without knowing original sound.
In unsupervised or weakly-supervised approaches for speech dereverberation, the target clean (dry) signals are considered to be unknown during training. In that context, evaluating to what extent information can be retrieved from the sole knowledge of reverberant (wet) speech becomes critical. This work investigates the role of the reverberant (wet) phase in the time-frequency domain. Based on Statistical Wave Field Theory, we show that late reverberation perturbs phase components with white, uniformly distributed noise, except at low frequencies. Consequently, the wet phase carries limited useful information and is not essential for weakly supervised dereverberation. To validate this finding, we train dereverberation models under a recent weak supervision framework and demonstrate that performance can be significantly improved by excluding the reverberant phase from the loss function.
Similar Papers
U-DREAM: Unsupervised Dereverberation guided by a Reverberation Model
Sound
Cleans up echoey sounds without needing perfect recordings.
Déréverbération non-supervisée de la parole par modèle hybride
Sound
Cleans up echoey voices without needing perfect recordings.
Dereverberation Using Binary Residual Masking with Time-Domain Consistency
Sound
Cleans up echo in voices for clearer sound.