Data Augmentation Using Neural Acoustic Fields With Retrieval-Augmented Pre-training
By: Christopher Ick , Gordon Wichern , Yoshiki Masuyama and more
Potential Business Impact:
Makes sound in empty rooms sound real.
This report details MERL's system for room impulse response (RIR) estimation submitted to the Generative Data Augmentation Workshop at ICASSP 2025 for Augmenting RIR Data (Task 1) and Improving Speaker Distance Estimation (Task 2). We first pre-train a neural acoustic field conditioned by room geometry on an external large-scale dataset in which pairs of RIRs and the geometries are provided. The neural acoustic field is then adapted to each target room by using the enrollment data, where we leverage either the provided room geometries or geometries retrieved from the external dataset, depending on availability. Lastly, we predict the RIRs for each pair of source and receiver locations specified by Task 1, and use these RIRs to train the speaker distance estimation model in Task 2.
Similar Papers
Hearing Anywhere in Any Environment
CV and Pattern Recognition
Makes virtual sounds feel real in any room.
Explicit Context-Driven Neural Acoustic Modeling for High-Fidelity RIR Generation
Sound
Makes computer sounds sound like real rooms.
PromptReverb: Multimodal Room Impulse Response Generation Through Latent Rectified Flow Matching
Sound
Makes virtual sounds feel real using words.