Score: 0

Data Augmentation Using Neural Acoustic Fields With Retrieval-Augmented Pre-training

Published: April 19, 2025 | arXiv ID: 2504.14409v1

By: Christopher Ick , Gordon Wichern , Yoshiki Masuyama and more

Potential Business Impact:

Makes sound in empty rooms sound real.

Business Areas:
Speech Recognition Data and Analytics, Software

This report details MERL's system for room impulse response (RIR) estimation submitted to the Generative Data Augmentation Workshop at ICASSP 2025 for Augmenting RIR Data (Task 1) and Improving Speaker Distance Estimation (Task 2). We first pre-train a neural acoustic field conditioned by room geometry on an external large-scale dataset in which pairs of RIRs and the geometries are provided. The neural acoustic field is then adapted to each target room by using the enrollment data, where we leverage either the provided room geometries or geometries retrieved from the external dataset, depending on availability. Lastly, we predict the RIRs for each pair of source and receiver locations specified by Task 1, and use these RIRs to train the speaker distance estimation model in Task 2.

Page Count
2 pages

Category
Electrical Engineering and Systems Science:
Audio and Speech Processing