Moises-Light: Resource-efficient Band-split U-Net For Music Source Separation
By: Yun-Ning , Hung , Igor Pereira and more
Potential Business Impact:
Separates music into parts using less computer power.
In recent years, significant advances have been made in music source separation, with model architectures such as dual-path modeling, band-split modules, or transformer layers achieving comparably good results. However, these models often contain a significant number of parameters, posing challenges to devices with limited computational resources in terms of training and practical application. While some lightweight models have been introduced, they generally perform worse compared to their larger counterparts. In this paper, we take inspiration from these recent advances to improve a lightweight model. We demonstrate that with careful design, a lightweight model can achieve comparable SDRs to models with up to 13 times more parameters. Our proposed model, Moises-Light, achieves competitive results in separating four musical stems on the MUSDB-HQ benchmark dataset. The proposed model also demonstrates competitive scalability when using MoisesDB as additional training data.
Similar Papers
A Conditioned UNet for Music Source Separation
Sound
Separates music into any instruments you want.
Mamba2 Meets Silence: Robust Vocal Source Separation for Sparse Regions
Sound
Cleans songs to hear only the singer.
Towards Practical Real-Time Low-Latency Music Source Separation
Sound
Lets music apps separate songs instantly.