Exploring Parent-Child Perceptions on Safety in Generative AI: Concerns, Mitigation Strategies, and Design Implications (2406.10461v2)

Abstract: The widespread use of Generative Artificial Intelligence (GAI) among teenagers has led to significant misuse and safety concerns. To identify risks and understand parental controls challenges, we conducted a content analysis on Reddit and interviewed 20 participants (seven teenagers and 13 parents). Our study reveals a significant gap in parental awareness of the extensive ways children use GAI, such as interacting with character-based chatbots for emotional support or engaging in virtual relationships. Parents and children report differing perceptions of risks associated with GAI. Parents primarily express concerns about data collection, misinformation, and exposure to inappropriate content. In contrast, teenagers are more concerned about becoming addicted to virtual relationships with GAI, the potential misuse of GAI to spread harmful content in social groups, and the invasion of privacy due to unauthorized use of their personal data in GAI applications. The absence of parental control features on GAI platforms forces parents to rely on system-built controls, manually check histories, share accounts, and engage in active mediation. Despite these efforts, parents struggle to grasp the full spectrum of GAI-related risks and to perform effective real-time monitoring, mediation, and education. We provide design recommendations to improve parent-child communication and enhance the safety of GAI use.

Exploring Parent-Child Perceptions on Safety in Generative AI: Concerns, Mitigation Strategies, and Design Implications

The paper "Exploring Parent-Child Perceptions on Safety in Generative AI: Concerns, Mitigation Strategies, and Design Implications" conducts a comprehensive analysis of the interaction between children and Generative AI (GAI) technologies. Through content analysis of Reddit posts and interviews with both teenagers and their parents, the paper provides an in-depth exploration of the disparate perceptions of safety and risk emergent in the usage of GAI among young populations. The research highlights the disconnect between parental awareness and children's actual utilization of GAI, illustrating a significant gap that impacts the effectiveness of risk mitigation strategies.

Key Findings

1. Teenager Utilization and Parental Awareness: The paper uncovers that teenagers are engaging with GAI tools for emotional support, social interactions, and educational purposes in ways that substantially diverge from parental assumptions. While many parents are under the impression that their children hardly use GAI tools or limit their use to well-known platforms like ChatGPT, children report employing these technologies extensively, with applications ranging from creating chatbots to using AI for academic work and social engagements.
2. Diverse Risk Perceptions: There is a noticeable disparity in risk perceptions between parents and children. Parents primarily express concerns about data privacy, misinformation, and the exposure to inappropriate content, whereas teenagers showcase heightened awareness of the social consequences of GAI, including addiction to virtual relationships with AI companions and privacy breaches from unauthorized data use.
3. Challenges in Parental Mediation: Confronted with insufficient built-in parental control features and limited functionality in current tools, most parents resort to non-technical methods such as manually checking their children's interaction histories or engaging in open dialogues. However, these strategies often fall short in providing real-time oversight or education, underscoring the need for more robust parental guidance solutions that align with the evolving capabilities of GAI systems.

Practical and Theoretical Implications

The findings suggest pressing implications for the development of GAI technologies that align with the safety and developmental needs of younger users:

• Design of Adaptive Parental Controls: There is a critical need for GAI platforms to introduce advanced, customizable content filtering systems that empower parents to set dynamic boundaries tailored to their child's maturity and personal context. Such systems could incorporate AI to aid in discerning appropriate content and offer parents increased control over children's digital environments.
• Facilitating Educative Dialogues: The paper underscores the importance of facilitating effective parent-child dialogues about online risks. It suggests the integration of educational resources within GAI platforms to aid parents in communicating the nuances of GAI technology and associated risks, thereby fostering informed coping strategies for adolescents.
• Establishing Clear Risk Frameworks: For both consumers and developers, a comprehensive understanding of the unique risks associated with GAI for minors is essential. Establishing clear, accessible risk frameworks can guide stakeholder actions and provide a foundation for policy and regulation development to ensure safe GAI interactions.

Conclusion

Overall, this paper provides valuable insights into the complex dynamics of children’s interaction with Generative AI and the critical need for more nuanced and robust systems for parental guidance and risk management. As GAI continues to evolve and permeate everyday life, it is imperative that the concerns and needs of both children and parents are intertwined into the fabric of future AI systems, ensuring safety and fostering the responsible use of this transformative technology.