AI Models Exceed Individual Human Accuracy in Predicting Everyday Social Norms
By: Pontus Strimling , Simon Karlsson , Irina Vartanova and more
Potential Business Impact:
AI learns right from wrong just by reading.
A fundamental question in cognitive science concerns how social norms are acquired and represented. While humans typically learn norms through embodied social experience, we investigated whether large language models can achieve sophisticated norm understanding through statistical learning alone. Across two studies, we systematically evaluated multiple AI systems' ability to predict human social appropriateness judgments for 555 everyday scenarios by examining how closely they predicted the average judgment compared to each human participant. In Study 1, GPT-4.5's accuracy in predicting the collective judgment on a continuous scale exceeded that of every human participant (100th percentile). Study 2 replicated this, with Gemini 2.5 Pro outperforming 98.7% of humans, GPT-5 97.8%, and Claude Sonnet 4 96.0%. Despite this predictive power, all models showed systematic, correlated errors. These findings demonstrate that sophisticated models of social cognition can emerge from statistical learning over linguistic data alone, challenging strong versions of theories emphasizing the exclusive necessity of embodied experience for cultural competence. The systematic nature of AI limitations across different architectures indicates potential boundaries of pattern-based social understanding, while the models' ability to outperform nearly all individual humans in this predictive task suggests that language serves as a remarkably rich repository for cultural knowledge transmission.
Similar Papers
AI Ethics and Social Norms: Exploring ChatGPT's Capabilities From What to How
Computers and Society
Checks if AI like ChatGPT is fair and safe.
Based AI improves human decision-making but reduces trust
Human-Computer Interaction
Biased AI helps people think better, but they trust it less.
On the Influence of Artificial Intelligence on Human Problem-Solving: Empirical Insights for the Third Wave in a Multinational Longitudinal Pilot Study
Computers and Society
Helps people check AI answers better.