Who are you, ChatGPT? Personality and Demographic Style in LLM-Generated Content
By: Dana Sotto Porat, Ella Rabinovich
Potential Business Impact:
Computers show personalities like people.
Generative large language models (LLMs) have become central to everyday life, producing human-like text across diverse domains. A growing body of research investigates whether these models also exhibit personality- and demographic-like characteristics in their language. In this work, we introduce a novel, data-driven methodology for assessing LLM personality without relying on self-report questionnaires, applying instead automatic personality and gender classifiers to model replies on open-ended questions collected from Reddit. Comparing six widely used models to human-authored responses, we find that LLMs systematically express higher Agreeableness and lower Neuroticism, reflecting cooperative and stable conversational tendencies. Gendered language patterns in model text broadly resemble those of human writers, though with reduced variation, echoing prior findings on automated agents. We contribute a new dataset of human and model responses, along with large-scale comparative analyses, shedding new light on the topic of personality and demographic patterns of generative AI.
Similar Papers
ChatGPT is not A Man but Das Man: Representativeness and Structural Consistency of Silicon Samples Generated by Large Language Models
Computation and Language
AI chatbots don't show real people's opinions.
Mind Reading or Misreading? LLMs on the Big Five Personality Test
Computation and Language
Helps computers guess your personality from writing.
Can LLMs Infer Personality from Real World Conversations?
Computation and Language
Computers can't accurately guess your personality yet.