Probabilistic Modeling of Intentions in Socially Intelligent LLM Agents
By: Feifan Xia , Yuyang Fang , Defang Li and more
Potential Business Impact:
Helps AI understand what you *really* mean.
We present a probabilistic intent modeling framework for large language model (LLM) agents in multi-turn social dialogue. The framework maintains a belief distribution over a partner's latent intentions, initialized from contextual priors and dynamically updated through likelihood estimation after each utterance. The evolving distribution provides additional contextual grounding for the policy, enabling adaptive dialogue strategies under uncertainty. Preliminary experiments in the SOTOPIA environment show consistent improvements: the proposed framework increases the Overall score by 9.0% on SOTOPIA-All and 4.1% on SOTOPIA-Hard compared with the Qwen2.5-7B baseline, and slightly surpasses an oracle agent that directly observes partner intentions. These early results suggest that probabilistic intent modeling can contribute to the development of socially intelligent LLM agents.
Similar Papers
Simulating Generative Social Agents via Theory-Informed Workflow Design
Artificial Intelligence
Makes computer characters act more like real people.
Social World Models
Artificial Intelligence
Helps AI understand people's feelings and actions.
Towards Trustworthy Multi-Turn LLM Agents via Behavioral Guidance
Artificial Intelligence
Makes AI agents follow rules and complete tasks.