Families' Vision of Generative AI Agents for Household Safety Against Digital and Physical Threats
By: Zikai Wen, Lanjing Liu, Yaxing Yao
Potential Business Impact:
AI agents help families stay safe at home.
As families face increasingly complex safety challenges in digital and physical environments, generative AI (GenAI) presents new opportunities to support household safety through multiple specialized AI agents. Through a two-phase qualitative study consisting of individual interviews and collaborative sessions with 13 parent-child dyads, we explored families' conceptualizations of GenAI and their envisioned use of AI agents in daily family life. Our findings reveal that families preferred to distribute safety-related support across multiple AI agents, each embodying a familiar caregiving role: a household manager coordinating routine tasks and mitigating risks such as digital fraud and home accidents; a private tutor providing personalized educational support, including safety education; and a family therapist offering emotional support to address sensitive safety issues such as cyberbullying and digital harassment. Families emphasized the need for agent-specific privacy boundaries, recognized generational differences in trust toward AI agents, and stressed the importance of maintaining open family communication alongside the assistance of AI agents. Based on these findings, we propose a multi-agent system design featuring four privacy-preserving principles: memory segregation, conversational consent, selective data sharing, and progressive memory management to help balance safety, privacy, and autonomy within family contexts.
Similar Papers
Families' Vision of Generative AI Agents for Household Safety Against Digital and Physical Threats
Human-Computer Interaction
AI agents help families stay safe at home.
Exploring Families' Use and Mediation of Generative AI: A Multi-User Perspective
Human-Computer Interaction
Helps parents guide kids using smart AI.
A Theoretical Framework of Student Agency in AI- Assisted Learning: A Grounded Theory Approach
Human-Computer Interaction
Helps students use AI smartly to learn better.