Time delay embeddings to characterize the timbre of musical instruments using Topological Data Analysis: a study on synthetic and real data
By: Gakusei Sato, Hiroya Nakao, Riccardo Muolo
Potential Business Impact:
Identifies music notes by sound's unique "flavor."
Timbre allows us to distinguish between sounds even when they share the same pitch and loudness, playing an important role in music, instrument recognition, and speech. Traditional approaches, such as frequency analysis or machine learning, often overlook subtle characteristics of sound. Topological Data Analysis (TDA) can capture complex patterns, but its application to timbre has been limited, partly because it is unclear how to represent sound effectively for TDA. In this study, we investigate how different time delay embeddings affect TDA results. Using both synthetic and real audio signals, we identify time delays that enhance the detection of harmonic structures. Our findings show that specific delays, related to fractions of the fundamental period, allow TDA to reveal key harmonic features and distinguish between integer and non-integer harmonics. The method is effective for synthetic and real musical instrument sounds and opens the way for future works, which could extend it to more complex sounds using higher-dimensional embeddings and additional persistence statistics.
Similar Papers
On Time Delay Interpolation for Improved Acoustic Reflector Localization
Audio and Speech Processing
Finds sound echoes more precisely.
Tracking Temporal Evolution of Topological Features in Image Data
Methodology
Finds patterns in changing pictures over time.
Challenges in 3D Data Synthesis for Training Neural Networks on Topological Features
CV and Pattern Recognition
Creates 3D shapes to teach computers about holes.