Explainable Ethical Assessment on Human Behaviors by Generating Conflicting Social Norms
By: Yuxi Sun , Wei Gao , Hongzhan Lin and more
Potential Business Impact:
AI learns right from wrong by seeing good and bad reasons.
Human behaviors are often guided or constrained by social norms, which are defined as shared, commonsense rules. For example, underlying an action ``\textit{report a witnessed crime}" are social norms that inform our conduct, such as ``\textit{It is expected to be brave to report crimes}''. Current AI systems that assess valence (i.e., support or oppose) of human actions by leveraging large-scale data training not grounded on explicit norms may be difficult to explain, and thus untrustworthy. Emulating human assessors by considering social norms can help AI models better understand and predict valence. While multiple norms come into play, conflicting norms can create tension and directly influence human behavior. For example, when deciding whether to ``\textit{report a witnessed crime}'', one may balance \textit{bravery} against \textit{self-protection}. In this paper, we introduce \textit{ClarityEthic}, a novel ethical assessment approach, to enhance valence prediction and explanation by generating conflicting social norms behind human actions, which strengthens the moral reasoning capabilities of language models by using a contrastive learning strategy. Extensive experiments demonstrate that our method outperforms strong baseline approaches, and human evaluations confirm that the generated social norms provide plausible explanations for the assessment of human behaviors.
Similar Papers
Cultural Compass: A Framework for Organizing Societal Norms to Detect Violations in Human-AI Conversations
Computers and Society
Teaches AI to follow rules in different countries.
Would I regret being different? The influence of social norms on attitudes toward AI usage
Human-Computer Interaction
People trust AI more when friends or bosses do.
The Goofus & Gallant Story Corpus for Practical Value Alignment
Artificial Intelligence
Teaches AI to act right, like good kids.