Investigating training objective for flow matching-based speech enhancement
By: Liusha Yang , Ziru Ge , Gui Zhang and more
Potential Business Impact:
Cleans up noisy sounds for clearer talking.
Speech enhancement(SE) aims to recover clean speech from noisy recordings. Although generative approaches such as score matching and Schrodinger bridge have shown strong effectiveness, they are often computationally expensive. Flow matching offers a more efficient alternative by directly learning a velocity field that maps noise to data. In this work, we present a systematic study of flow matching for SE under three training objectives: velocity prediction, $x_1$ prediction, and preconditioned $x_1$ prediction. We analyze their impact on training dynamics and overall performance. Moreover, by introducing perceptual(PESQ) and signal-based(SI-SDR) objectives, we further enhance convergence efficiency and speech quality, yielding substantial improvements across evaluation metrics.
Similar Papers
Shortcut Flow Matching for Speech Enhancement: Step-Invariant flows via single stage training
Sound
Cleans up noisy audio much faster.
MeanFlowSE: one-step generative speech enhancement via conditional mean flow
Sound
Makes noisy voices clear in one step.
Flowing Straighter with Conditional Flow Matching for Accurate Speech Enhancement
Sound
Makes noisy voices sound clear, faster.