Social World Models
By: Xuhui Zhou , Jiarui Liu , Akhila Yerukola and more
Potential Business Impact:
Helps AI understand people's feelings and actions.
Humans intuitively navigate social interactions by simulating unspoken dynamics and reasoning about others' perspectives, even with limited information. In contrast, AI systems struggle to automatically structure and reason about these implicit social contexts. In this paper, we introduce a novel structured social world representation formalism (S3AP), designed to help AI systems reason more effectively about social dynamics. Following a POMDP-driven design, S3AP represents social interactions as structured tuples, such as state, observation, agent actions, and mental states, which can be automatically induced from free-form narratives or other inputs. We first show S3AP can help LLMs better understand social narratives across 5 social reasoning tasks (e.g., +51% improvement on FANToM's theory-of-mind reasoning with OpenAI's o1), reaching new state-of-the-art (SOTA) performance. We then induce social world models from these structured representations, demonstrating their ability to predict future social dynamics and improve agent decision-making, yielding up to +18% improvement on the SOTOPIA social interaction benchmark. Our findings highlight the promise of S3AP as a powerful, general-purpose representation for social world states, enabling the development of more socially-aware systems that better navigate social interactions.
Similar Papers
Social World Model-Augmented Mechanism Design Policy Learning
Computers and Society
Helps computers learn how people will act.
Probabilistic Modeling of Intentions in Socially Intelligent LLM Agents
Artificial Intelligence
Helps AI understand what you *really* mean.
Simulating Generative Social Agents via Theory-Informed Workflow Design
Artificial Intelligence
Makes computer characters act more like real people.