Gesture-Based Robot Control Integrating Mm-wave Radar and Behavior Trees
By: Yuqing Song , Cesare Tonola , Stefano Savazzi and more
Potential Business Impact:
Robots move with hand waves, no touching needed.
As robots become increasingly prevalent in both homes and industrial settings, the demand for intuitive and efficient human-machine interaction continues to rise. Gesture recognition offers an intuitive control method that does not require physical contact with devices and can be implemented using various sensing technologies. Wireless solutions are particularly flexible and minimally invasive. While camera-based vision systems are commonly used, they often raise privacy concerns and can struggle in complex or poorly lit environments. In contrast, radar sensing preserves privacy, is robust to occlusions and lighting, and provides rich spatial data such as distance, relative velocity, and angle. We present a gesture-controlled robotic arm using mm-wave radar for reliable, contactless motion recognition. Nine gestures are recognized and mapped to real-time commands with precision. Case studies are conducted to demonstrate the system practicality, performance and reliability for gesture-based robotic manipulation. Unlike prior work that treats gesture recognition and robotic control separately, our system unifies both into a real-time pipeline for seamless, contactless human-robot interaction.
Similar Papers
Live Demonstration: Neuromorphic Radar for Gesture Recognition
CV and Pattern Recognition
Lets computers understand hand waves using tiny radar.
Live Demonstration: Neuromorphic Radar for Gesture Recognition
CV and Pattern Recognition
Recognizes hand waves using tiny, smart radar.
Advancing Radar Hand Gesture Recognition: A Hybrid Spectrum Synthetic Framework Merging Simulation with Neural Networks
Human-Computer Interaction
Lets computers understand hand waves better.