Toward Deployable Multi-Robot Collaboration via a Symbolically-Guided Decision Transformer
By: Rathnam Vidushika Rasanji , Jin Wei-Kocsis , Jiansong Zhang and more
Potential Business Impact:
Helps robots work together to do tasks.
Plain English Summary
Robots can now work together much more effectively to complete complex tasks, like assembling products or moving heavy objects. This new method helps robots understand and follow a clear plan, even when things change unexpectedly. This means robots can be more reliable and useful in factories and warehouses, making production faster and more efficient.
Reinforcement learning (RL) has demonstrated great potential in robotic operations. However, its data-intensive nature and reliance on the Markov Decision Process (MDP) assumption limit its practical deployment in real-world scenarios involving complex dynamics and long-term temporal dependencies, such as multi-robot manipulation. Decision Transformers (DTs) have emerged as a promising offline alternative by leveraging causal transformers for sequence modeling in RL tasks. However, their applications to multi-robot manipulations still remain underexplored. To address this gap, we propose a novel framework, Symbolically-Guided Decision Transformer (SGDT), which integrates a neuro-symbolic mechanism with a causal transformer to enable deployable multi-robot collaboration. In the proposed SGDT framework, a neuro-symbolic planner generates a high-level task-oriented plan composed of symbolic subgoals. Guided by these subgoals, a goal-conditioned decision transformer (GCDT) performs low-level sequential decision-making for multi-robot manipulation. This hierarchical architecture enables structured, interpretable, and generalizable decision making in complex multi-robot collaboration tasks. We evaluate the performance of SGDT across a range of task scenarios, including zero-shot and few-shot scenarios. To our knowledge, this is the first work to explore DT-based technology for multi-robot manipulation.
Similar Papers
Dual-Head Physics-Informed Graph Decision Transformer for Distribution System Restoration
Systems and Control
Fixes power grids faster, even with new problems.
Dual-Head Physics-Informed Graph Decision Transformer for Distribution System Restoration
Systems and Control
Fixes power grids faster, even when new problems arise.
Decoupling Return-to-Go for Efficient Decision Transformer
Artificial Intelligence
Makes robots learn better by simplifying how they think.