Quantifying and Reducing Speaker Heterogeneity within the Common Voice Corpus for Phonetic Analysis
By: Miao Zhang , Aref Farhadipour , Annie Baker and more
Potential Business Impact:
Improves voice recognition for different people.
With its crosslinguistic and cross-speaker diversity, the Mozilla Common Voice Corpus (CV) has been a valuable resource for multilingual speech technology and holds tremendous potential for research in crosslinguistic phonetics and speech sciences. Properly accounting for speaker variation is, however, key to the theoretical and statistical bases of speech research. While CV provides a client ID as an approximation to a speaker ID, multiple speakers can contribute under the same ID. This study aims to quantify and reduce heterogeneity in the client ID for a better approximation of a true, though still anonymous speaker ID. Using ResNet-based voice embeddings, we obtained a similarity score among recordings with the same client ID, then implemented a speaker discrimination task to identify an optimal threshold for reducing perceived speaker heterogeneity. These results have major downstream applications for phonetic analysis and the development of speaker-based speech technology.
Similar Papers
Quantifying Source Speaker Leakage in One-to-One Voice Conversion
Sound
Identifies who is speaking in fake voices.
Bridging the Language Gap: Synthetic Voice Diversity via Latent Mixup for Equitable Speech Recognition
Computation and Language
Helps computers understand less common languages better.
Analyzing and Improving Speaker Similarity Assessment for Speech Synthesis
Sound
Makes cloned voices sound more like real people.