Anticipate, Simulate, Reason (ASR): A Comprehensive Generative AI Framework for Combating Messaging Scams
By: Xue Wen Tan, Kenneth See, Stanley Kok
Potential Business Impact:
Helps you spot fake messages before they trick you.
The rapid growth of messaging scams creates an escalating challenge for user security and financial safety. In this paper, we present the \textit{Anticipate, Simulate, Reason} (ASR) generative AI framework to enable users to proactively identify and comprehend scams within instant messaging platforms. Using large language models, ASR predicts scammer responses and delivers real-time, interpretable support to end-users. We also develop ScamGPT-J, a domain-specific language model fine-tuned on a new, high-quality dataset of scam conversations covering multiple scam types. Thorough experimental evaluation shows that the ASR framework substantially enhances scam detection, particularly in challenging contexts such as job scams, and uncovers important demographic patterns in user vulnerability and perceptions of AI-generated assistance. Our findings reveal a contradiction where those most at risk are often least receptive to AI support, emphasizing the importance of user-centered design in AI-driven fraud prevention. This work advances both the practical and theoretical foundations for interpretable and human-centered AI systems in combating evolving digital threats.
Similar Papers
Anticipate, Simulate, Reason (ASR): A Comprehensive Generative AI Framework for Combating Messaging Scams
Human-Computer Interaction
Spots scam messages before you reply.
ASRJam: Human-Friendly AI Speech Jamming to Prevent Automated Phone Scams
Computation and Language
Stops scam calls by making them hard for computers.
ScamAgents: How AI Agents Can Simulate Human-Level Scam Calls
Cryptography and Security
Creates fake phone calls to trick people.