Software Engineering Agents for Embodied Controller Generation : A Study in Minigrid Environments
By: Timothé Boulet, Xavier Hinaut, Clément Moulin-Frier
Potential Business Impact:
Helps robots learn to do new jobs.
Software Engineering Agents (SWE-Agents) have proven effective for traditional software engineering tasks with accessible codebases, but their performance for embodied tasks requiring well-designed information discovery remains unexplored. We present the first extended evaluation of SWE-Agents on controller generation for embodied tasks, adapting Mini-SWE-Agent (MSWEA) to solve 20 diverse embodied tasks from the Minigrid environment. Our experiments compare agent performance across different information access conditions: with and without environment source code access, and with varying capabilities for interactive exploration. We quantify how different information access levels affect SWE-Agent performance for embodied tasks and analyze the relative importance of static code analysis versus dynamic exploration for task solving. This work establishes controller generation for embodied tasks as a crucial evaluation domain for SWE-Agents and provides baseline results for future research in efficient reasoning systems.
Similar Papers
Understanding Software Engineering Agents Through the Lens of Traceability: An Empirical Study
Software Engineering
Helps computers write better, more human-like code.
Training Versatile Coding Agents in Synthetic Environments
Software Engineering
Teaches computers to code and fix bugs.
Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?
Software Engineering
Computer program learns to fix itself while working.