Enhanced Automatic Drum Transcription via Drum Stem Source Separation
By: Xavier Riley, Simon Dixon
Potential Business Impact:
Makes drum music sound more real.
Automatic Drum Transcription (ADT) remains a challenging task in MIR but recent advances allow accurate transcription of drum kits with up 5 classes - kick, snare, hi-hats, toms and cymbals - via the ADTOF package. In addition, several drum kit \emph{stem} separation models in the open source community support separation for more than 6 stem classes, including distinct crash and ride cymbals. In this work we explore the benefits of combining these tools to improve the realism of drum transcriptions. We describe a simple post-processing step which expands the transcription output from five to seven classes and furthermore, we are able to estimate MIDI velocity values based on the separated stems. Our solution achieves strong performance when assessed against a baseline of 8-class drum transcription and produces realistic MIDI transcriptions suitable for MIR or music production tasks.
Similar Papers
Noise-to-Notes: Diffusion-based Generation and Refinement for Automatic Drum Transcription
Sound
Turns music sounds into drum notes and beats.
TART: A Comprehensive Tool for Technique-Aware Audio-to-Tab Guitar Transcription
Sound
Turns guitar music into written notes.
The Inverse Drum Machine: Source Separation Through Joint Transcription and Analysis-by-Synthesis
Sound
Separates music into drum sounds without needing full songs.