LTLCodeGen: Code Generation of Syntactically Correct Temporal Logic for Robot Task Planning
By: Behrad Rabiei , Mahesh Kumar A. R. , Zhirui Dai and more
Potential Business Impact:
Robots follow spoken directions to move around.
This paper focuses on planning robot navigation tasks from natural language specifications. We develop a modular approach, where a large language model (LLM) translates the natural language instructions into a linear temporal logic (LTL) formula with propositions defined by object classes in a semantic occupancy map. The LTL formula and the semantic occupancy map are provided to a motion planning algorithm to generate a collision-free robot path that satisfies the natural language instructions. Our main contribution is LTLCodeGen, a method to translate natural language to syntactically correct LTL using code generation. We demonstrate the complete task planning method in real-world experiments involving human speech to provide navigation instructions to a mobile robot. We also thoroughly evaluate our approach in simulated and real-world experiments in comparison to end-to-end LLM task planning and state-of-the-art LLM-to-LTL translation methods.
Similar Papers
Automatic Generation of Safety-compliant Linear Temporal Logic via Large Language Model: A Self-supervised Framework
Logic in Computer Science
Makes sure computer instructions are safe.
ConformalNL2LTL: Translating Natural Language Instructions into Temporal Logic Formulas with Conformal Correctness Guarantees
Computation and Language
Teaches robots to follow spoken commands correctly.
Motion Planning Under Temporal Logic Specifications In Semantically Unknown Environments
Robotics
Helps robots navigate unknown places to do jobs.