DARC: Drum accompaniment generation with fine-grained rhythm control
By: Trey Brosnan
Potential Business Impact:
Makes music makers control drum beats easily.
In music creation, rapid prototyping is essential for exploring and refining ideas, yet existing generative tools often fall short when users require both structural control and stylistic flexibility. Prior approaches in stem-to-stem generation can condition on other musical stems but offer limited control over rhythm, and timbre-transfer methods allow users to specify specific rhythms, but cannot condition on musical context. We introduce DARC, a generative drum accompaniment model that conditions both on musical context from other stems and explicit rhythm prompts such as beatboxing or tapping tracks. Using parameter-efficient fine-tuning, we augment STAGE, a state-of-the-art drum stem generator, with fine-grained rhythm control while maintaining musical context awareness.
Similar Papers
DiffRhythm+: Controllable and Flexible Full-Length Song Generation with Preference Optimization
Audio and Speech Processing
Makes computers write better, more creative songs.
STAGE: Stemmed Accompaniment Generation through Prefix-Based Conditioning
Sound
Helps musicians add music to their songs.
JAM: A Tiny Flow-based Song Generator with Fine-grained Controllability and Aesthetic Alignment
Sound
Makes songs with exact word timing and sound.