RobustFlow: Towards Robust Agentic Workflow Generation
By: Shengxiang Xu , Jiayi Zhang , Shimin Di and more
Potential Business Impact:
Makes AI follow instructions even when rephrased.
The automated generation of agentic workflows is a promising frontier for enabling large language models (LLMs) to solve complex tasks. However, our investigation reveals that the robustness of agentic workflow remains a critical, unaddressed challenge. Current methods often generate wildly inconsistent workflows when provided with instructions that are semantically identical but differently phrased. This brittleness severely undermines their reliability and trustworthiness for real-world applications. To quantitatively diagnose this instability, we propose metrics based on nodal and topological similarity to evaluate workflow consistency against common semantic variations such as paraphrasing and noise injection. Subsequently, we further propose a novel training framework, RobustFlow, that leverages preference optimization to teach models invariance to instruction variations. By training on sets of synonymous task descriptions, RobustFlow boosts workflow robustness scores to 70\% - 90\%, which is a substantial improvement over existing approaches. The code is publicly available at https://github.com/DEFENSE-SEU/RobustFlow.
Similar Papers
RobustFlow: Towards Robust Agentic Workflow Generation
Multiagent Systems
Makes AI follow instructions even when rephrased.
AdaptFlow: Adaptive Workflow Optimization via Meta-Learning
Artificial Intelligence
Computers learn to solve new problems faster.
$A^2Flow:$ Automating Agentic Workflow Generation via Self-Adaptive Abstraction Operators
Artificial Intelligence
Automates computer task planning without human help.