Learning Control of Neural Sound Effects Synthesis from Physically Inspired Models
By: Yisu Zong, Joshua Reiss
Potential Business Impact:
Makes computer-made sounds sound real and controllable.
Sound effects model design commonly uses digital signal processing techniques with full control ability, but it is difficult to achieve realism within a limited number of parameters. Recently, neural sound effects synthesis methods have emerged as a promising approach for generating high-quality and realistic sounds, but the process of synthesizing the desired sound poses difficulties in terms of control. This paper presents a real-time neural synthesis model guided by a physically inspired model, enabling the generation of high-quality sounds while inheriting the control interface of the physically inspired model. We showcase the superior performance of our model in terms of sound quality and control.
Similar Papers
Neural Proxies for Sound Synthesizers: Learning Perceptually Informed Preset Representations
Sound
Makes computers create new music sounds.
Acoustic neural networks: Identifying design principles and exploring physical feasibility
Sound
Sound waves do math for super-fast, low-power computers.
Designing Neural Synthesizers for Low-Latency Interaction
Sound
Lets musicians change music sounds instantly.