Score: 0

AI Propaganda factories with language models

Published: August 27, 2025 | arXiv ID: 2508.20186v1

By: Lukasz Olejnik

Potential Business Impact:

Computers can now create fake political messages.

Business Areas:
Natural Language Processing Artificial Intelligence, Data and Analytics, Software

AI-powered influence operations can now be executed end-to-end on commodity hardware. We show that small language models produce coherent, persona-driven political messaging and can be evaluated automatically without human raters. Two behavioural findings emerge. First, persona-over-model: persona design explains behaviour more than model identity. Second, engagement as a stressor: when replies must counter-arguments, ideological adherence strengthens and the prevalence of extreme content increases. We demonstrate that fully automated influence-content production is within reach of both large and small actors. Consequently, defence should shift from restricting model access towards conversation-centric detection and disruption of campaigns and coordination infrastructure. Paradoxically, the very consistency that enables these operations also provides a detection signature.

Page Count
17 pages

Category
Computer Science:
Cryptography and Security