WebTrap Park: An Automated Platform for Systematic Security Evaluation of Web Agents
By: Xinyi Wu , Jiagui Chen , Geng Hong and more
Potential Business Impact:
Tests web robots for dangerous online actions.
Web Agents are increasingly deployed to perform complex tasks in real web environments, yet their security evaluation remains fragmented and difficult to standardize. We present WebTrap Park, an automated platform for systematic security evaluation of Web Agents through direct observation of their concrete interactions with live web pages. WebTrap Park instantiates three major sources of security risk into 1,226 executable evaluation tasks and enables action based assessment without requiring agent modification. Our results reveal clear security differences across agent frameworks, highlighting the importance of agent architecture beyond the underlying model. WebTrap Park is publicly accessible at https://security.fudan.edu.cn/webagent and provides a scalable foundation for reproducible Web Agent security evaluation.
Similar Papers
It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents
Human-Computer Interaction
Protects online helpers from tricky instructions.
WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks
Cryptography and Security
AI helpers can be tricked by simple tricks.
When Bots Take the Bait: Exposing and Mitigating the Emerging Social Engineering Attack in Web Automation Agent
Cryptography and Security
Protects web robots from being tricked online.