CERNet: Class-Embedding Predictive-Coding RNN for Unified Robot Motion, Recognition, and Confidence Estimation
By: Hiroki Sawada, Alexandre Pitti, Mathias Quoy
Potential Business Impact:
Robots understand and copy human movements better.
Robots interacting with humans must not only generate learned movements in real-time, but also infer the intent behind observed behaviors and estimate the confidence of their own inferences. This paper proposes a unified model that achieves all three capabilities within a single hierarchical predictive-coding recurrent neural network (PC-RNN) equipped with a class embedding vector, CERNet, which leverages a dynamically updated class embedding vector to unify motor generation and recognition. The model operates in two modes: generation and inference. In the generation mode, the class embedding constrains the hidden state dynamics to a class-specific subspace; in the inference mode, it is optimized online to minimize prediction error, enabling real-time recognition. Validated on a humanoid robot across 26 kinesthetically taught alphabets, our hierarchical model achieves 76% lower trajectory reproduction error than a parameter-matched single-layer baseline, maintains motion fidelity under external perturbations, and infers the demonstrated trajectory class online with 68% Top-1 and 81% Top-2 accuracy. Furthermore, internal prediction errors naturally reflect the model's confidence in its recognition. This integration of robust generation, real-time recognition, and intrinsic uncertainty estimation within a compact PC-RNN framework offers a compact and extensible approach to motor memory in physical robots, with potential applications in intent-sensitive human-robot collaboration.
Similar Papers
Fully Spiking Actor-Critic Neural Network for Robotic Manipulation
Robotics
Robots learn to grab things faster, using less power.
A Perception CNN for Facial Expression Recognition
CV and Pattern Recognition
Helps computers understand emotions from faces better.
UF-RNN: Real-Time Adaptive Motion Generation Using Uncertainty-Driven Foresight Prediction
Robotics
Helps robots learn to handle tricky, unknown situations.