Invisible Strings: Revealing Latent Dancer-to-Dancer Interactions with Graph Neural Networks
By: Luis Vitor Zerkowski , Zixuan Wang , Ilya Vidrin and more
Potential Business Impact:
Shows how dancers connect through movement.
Dancing in a duet often requires a heightened attunement to one's partner: their orientation in space, their momentum, and the forces they exert on you. Dance artists who work in partnered settings might have a strong embodied understanding in the moment of how their movements relate to their partner's, but typical documentation of dance fails to capture these varied and subtle relationships. Working closely with dance artists interested in deepening their understanding of partnering, we leverage Graph Neural Networks (GNNs) to highlight and interpret the intricate connections shared by two dancers. Using a video-to-3D-pose extraction pipeline, we extract 3D movements from curated videos of contemporary dance duets, apply a dedicated pre-processing to improve the reconstruction, and train a GNN to predict weighted connections between the dancers. By visualizing and interpreting the predicted relationships between the two movers, we demonstrate the potential for graph-based methods to construct alternate models of the collaborative dynamics of duets. Finally, we offer some example strategies for how to use these insights to inform a generative and co-creative studio practice.
Similar Papers
Dyads: Artist-Centric, AI-Generated Dance Duets
Machine Learning (CS)
AI creates dance partners that move together.
When Deepfake Detection Meets Graph Neural Network:a Unified and Lightweight Learning Framework
CV and Pattern Recognition
Finds fake videos using smart video tricks.
DanceGraph: A Complementary Architecture for Synchronous Dancing Online
Graphics
Lets people dance together online without lag.