Deep Reinforcement Learning with anticipatory reward in LSTM for Collision Avoidance of Mobile Robots
By: Olivier Poulet, Frédéric Guinand, François Guérin
Potential Business Impact:
Robots predict crashes, then avoid them safely.
This article proposes a collision risk anticipation method based on short-term prediction of the agents position. A Long Short-Term Memory (LSTM) model, trained on past trajectories, is used to estimate the next position of each robot. This prediction allows us to define an anticipated collision risk by dynamically modulating the reward of a Deep Q-Learning Network (DQN) agent. The approach is tested in a constrained environment, where two robots move without communication or identifiers. Despite a limited sampling frequency (1 Hz), the results show a significant decrease of the collisions number and a stability improvement. The proposed method, which is computationally inexpensive, appears particularly attractive for implementation on embedded systems.
Similar Papers
An LSTM-based Test Selection Method for Self-Driving Cars
Robotics
Tests self-driving cars faster by picking hard problems.
Learning Obstacle Avoidance using Double DQN for Quadcopter Navigation
Robotics
Drones learn to fly safely in cities.
Quantum-Enhanced Forecasting for Deep Reinforcement Learning in Algorithmic Trading
Machine Learning (CS)
Helps computers trade money better and safer.