Are Emotions Arranged in a Circle? Geometric Analysis of Emotion Representations via Hyperspherical Contrastive Learning
By: Yusuke Yamauchi, Akiko Aizawa
Potential Business Impact:
Makes AI understand feelings better by arranging them in a circle.
Psychological research has long utilized circumplex models to structure emotions, placing similar emotions adjacently and opposing ones diagonally. Although frequently used to interpret deep learning representations, these models are rarely directly incorporated into the representation learning of language models, leaving their geometric validity unexplored. This paper proposes a method to induce circular emotion representations within language model embeddings via contrastive learning on a hypersphere. We show that while this circular alignment offers superior interpretability and robustness against dimensionality reduction, it underperforms compared to conventional designs in high-dimensional settings and fine-grained classification. Our findings elucidate the trade-offs involved in applying psychological circumplex models to deep learning architectures.
Similar Papers
Bridging the behavior-neural gap: A multimodal AI reveals the brain's geometry of emotion more accurately than human self-reports
Human-Computer Interaction
AI understands feelings better than people's words.
Emotions Where Art Thou: Understanding and Characterizing the Emotional Latent Space of Large Language Models
Computation and Language
Teaches computers to understand and change feelings.
Emergence of Hierarchical Emotion Organization in Large Language Models
Computation and Language
Computers learn to understand feelings like people.