How Large Language Models Systematically Misrepresent American Climate Opinions
By: Sola Kim , Jieshu Wang , Marco A. Janssen and more
Potential Business Impact:
AI misrepresents how people feel about climate change.
Federal agencies and researchers increasingly use large language models to analyze and simulate public opinion. When AI mediates between the public and policymakers, accuracy across intersecting identities becomes consequential; inaccurate group-level estimates can mislead outreach, consultation, and policy design. While research examines intersectionality in LLM outputs, no study has compared these outputs against real human responses across intersecting identities. Climate policy is one such domain, and this is particularly urgent for climate change, where opinion is contested and diverse. We investigate how LLMs represent intersectional patterns in U.S. climate opinions. We prompted six LLMs with profiles of 978 respondents from a nationally representative U.S. climate opinion survey and compared AI-generated responses to actual human answers across 20 questions. We find that LLMs appear to compress the diversity of American climate opinions, predicting less-concerned groups as more concerned and vice versa. This compression is intersectional: LLMs apply uniform gender assumptions that match reality for White and Hispanic Americans but misrepresent Black Americans, where actual gender patterns differ. These patterns, which may be invisible to standard auditing approaches, could undermine equitable climate governance.
Similar Papers
Artificial Intelligence and Civil Discourse: How LLMs Moderate Climate Change Conversations
Computers and Society
AI calms down online arguments about climate change.
Investigating Intersectional Bias in Large Language Models using Confidence Disparities in Coreference Resolution
Computation and Language
Finds AI unfairly favors some people over others.
An Analysis of Large Language Models for Simulating User Responses in Surveys
Computation and Language
Helps computers understand many different opinions.