Between Myths and Metaphors: Rethinking LLMs for SRH in Conservative Contexts
By: Ameemah Humayun, Bushra Zubair, Maryam Mustafa
Potential Business Impact:
Helps computers understand private health talks.
Low-resource countries represent over 90% of maternal deaths, with Pakistan among the top four countries contributing nearly half in 2023. Since these deaths are mostly preventable, large language models (LLMs) can help address this crisis by automating health communication and risk assessment. However, sexual and reproductive health (SRH) communication in conservative contexts often relies on indirect language that obscures meaning, complicating LLM-based interventions. We conduct a two-stage study in Pakistan: (1) analyzing data from clinical observations, interviews, and focus groups with clinicians and patients, and (2) evaluating the interpretive capabilities of five popular LLMs on this data. Our analysis identifies two axes of communication (referential domain and expression approach) and shows LLMs struggle with semantic drift, myths, and polysemy in clinical interactions. We contribute: (1) empirical themes in SRH communication, (2) a categorization framework for indirect communication, (3) evaluation of LLM performance, and (4) design recommendations for culturally-situated SRH communication.
Similar Papers
Beyond the Rubric: Cultural Misalignment in LLM Benchmarks for Sexual and Reproductive Health
Computers and Society
Makes health chatbots work for different cultures.
When the Domain Expert Has No Time and the LLM Developer Has No Clinical Expertise: Real-World Lessons from LLM Co-Design in a Safety-Net Hospital
Computers and Society
Helps doctors quickly understand patient needs.
AI as We Describe It: How Large Language Models and Their Applications in Health are Represented Across Channels of Public Discourse
Human-Computer Interaction
Shows how people talk about AI, good and bad.