Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
80 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Toward Safe Evolution of Artificial Intelligence (AI) based Conversational Agents to Support Adolescent Mental and Sexual Health Knowledge Discovery (2404.03023v1)

Published 3 Apr 2024 in cs.HC and cs.AI

Abstract: Following the recent release of various AI based Conversation Agents (CAs), adolescents are increasingly using CAs for interactive knowledge discovery on sensitive topics, including mental and sexual health topics. Exploring such sensitive topics through online search has been an essential part of adolescent development, and CAs can support their knowledge discovery on such topics through human-like dialogues. Yet, unintended risks have been documented with adolescents' interactions with AI-based CAs, such as being exposed to inappropriate content, false information, and/or being given advice that is detrimental to their mental and physical well-being (e.g., to self-harm). In this position paper, we discuss the current landscape and opportunities for CAs to support adolescents' mental and sexual health knowledge discovery. We also discuss some of the challenges related to ensuring the safety of adolescents when interacting with CAs regarding sexual and mental health topics. We call for a discourse on how to set guardrails for the safe evolution of AI-based CAs for adolescents.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. Carlos Abreu and Pedro F Campos. 2022. Raising awareness of smartphone overuse among university students: a persuasive systems approach. In Informatics, Vol. 9. MDPI, 15.
  2. Anshu. 2023. Demystifying LLM-Driven Search: Stop Comparing Embeddings or VectorDBs and Start Fine-Tuning. https://medium.com/thirdai-blog/demystifying-llm-driven-search-stop-comparing-embeddings-or-vectordbs-and-start-fine-tuning-d9b6791146fe
  3. Effectiveness and acceptability of conversational agents for sexual health promotion: a systematic review and meta-analysis. Sexual health 19, 5 (2022), 391–405.
  4. Development of a positive body image chatbot (KIT) with young people and parents/carers: qualitative focus group study. Journal of medical Internet research 23, 6 (2021), e27807.
  5. Layla’s Got You: developing a tailored contraception chatbot for Black and Hispanic young women. Health Education Journal 80, 4 (2021), 413–424.
  6. Gilly Dosovitsky and Eduardo Bunge. 2023. Development of a chatbot for depression: adolescent perceptions and recommendations. Child and Adolescent Mental Health 28, 1 (2023), 124–127.
  7. Danielle Elmasri and Anthony Maeder. 2016. A conversational agent for an online mental health intervention. In Brain Informatics and Health: International Conference, BIH 2016, Omaha, NE, USA, October 13-16, 2016 Proceedings. Springer, 243–251.
  8. Elizabeth Foss and Allison Druin. 2014. Children’s internet search: Using roles to understand children’s search behavior. Morgan & Claypool Publishers.
  9. Geoffrey A Fowler. 2023. Snapchat tried to make a safe AI. It chats with me about booze and sex. https://www.washingtonpost.com/technology/2023/03/14/snapchat-myai/
  10. Engagement and effectiveness of a healthy-coping intervention via chatbot for university students during the COVID-19 pandemic: mixed methods proof-of-concept study. JMIR mHealth and uHealth 9, 5 (2021), e27965.
  11. A chatbot-based coaching intervention for adolescents to promote life skills: pilot study. JMIR human factors 7, 1 (2020), e16762.
  12. Howard Gardner and Katie Davis. 2013. The app generation: How today’s youth navigate identity, intimacy, and imagination in a digital world. Yale University Press.
  13. The last decade of HCI research on children and voice-based conversational agents. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–19.
  14. Google. 2023. Bard. https://bard.google.com/
  15. Christine Grové. 2021. Co-developing a mental health and wellbeing chatbot with and for young people. Frontiers in psychiatry 11 (2021), 606041.
  16. Motivators and barriers to accessing sexual health care services for transgender/genderqueer individuals assigned female sex at birth. Transgender Health 4, 1 (2019), 58–67.
  17. Mental health chatbot for young adults with depressive symptoms during the COVID-19 pandemic: single-blind, three-arm randomized controlled trial. Journal of Medical Internet Research 24, 11 (2022), e40719.
  18. Hi, can I help? Exploring how to design a mental health chatbot for youths. Human Technology 16, 2 (2020), 139–169.
  19. The White House. 2023. FACT SHEET: Biden-Harris Administration Announces New Actions to Promote Responsible AI Innovation that Protects Americans’ Rights and Safety. https://www.whitehouse.gov/briefing-room/statements-releases/2023/05/04/fact-sheet-biden-harris-administration-announces-new-actions-to-promote-responsible-ai-innovation-that-protects-americans-rights-and-safety/
  20. Understanding the benefits and challenges of deploying conversational AI leveraging large language models for public health intervention. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.
  21. Samantha Murphy Kelly. 2023. Snapchat’s new AI chatbot is already raising alarms among teens and parents. https://www.cnn.com/2023/04/27/tech/snapchat-my-ai-concerns-wellness/index.html
  22. Chatbots to support young adults’ mental health: an exploratory study of acceptability. ACM Transactions on Interactive Intelligent Systems (TiiS) 12, 2 (2022), 1–39.
  23. A Personalized Conversational Agent to Treat Depression in Youth and Young Adults–A Transdisciplinary Design Science Research Project. In International Conference on Design Science Research in Information Systems and Technology. Springer, 30–41.
  24. Iterative design and implementation of a chatbot for sexual and reproductive health counseling in Peru. In 2022 IEEE XXIX International Conference on Electronics, Electrical Engineering and Computing (INTERCON). IEEE, 1–4.
  25. Participatory development and pilot testing of an adolescent health promotion chatbot. Frontiers in Public Health 9 (2021), 724779.
  26. A Transgender Chatbot (Amanda Selfie) to Create Pre-exposure Prophylaxis Demand Among Adolescents in Brazil: Assessment of Acceptability, Functionality, Usability, and Results. Journal of Medical Internet Research 25 (2023), e41881.
  27. Microsoft. 2023. Introducing the new Bing. https://www.bing.com/?FORM=Z9FD1
  28. Barriers and facilitators to engagement with artificial intelligence (AI)-based chatbots for sexual and reproductive health advice: a qualitative analysis. Sexual health 18, 5 (2021), 385–393.
  29. Chatbot-delivered cognitive behavioral therapy in adolescents with depression and anxiety during the COVID-19 pandemic: feasibility and acceptability study. JMIR Formative Research 6, 11 (2022), e40242.
  30. OpenAI. 2023. Introducing ChatGPT. https://openai.com/blog/chatgpt
  31. Hyanghee Park and Joonhwan Lee. 2020. Can a Conversational Agent Lower Sexual Violence Victims’ Burden of Self-Disclosure?. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–8.
  32. Differences in information accessed in a pharmacologic knowledge base using a conversational agent vs traditional search methods. International Journal of Medical Informatics 153 (2021), 104530.
  33. Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. European child & adolescent psychiatry 30 (2021), 183–211.
  34. AdolescentBot: Understanding opportunities for chatbots in combating adolescent sexual and reproductive health problems in Bangladesh. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–15.
  35. Let’s talk about sext: How adolescents seek support and advice about their online sexual experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
  36. Elizabeth Reid. 2023. Supercharging Search with generative AI. https://blog.google/products/search/generative-ai-search/
  37. Systematic review: Trust-building factors and implications for conversational agent design. International Journal of Human–Computer Interaction 37, 1 (2021), 81–96.
  38. Melissa Rudy. 2023. Teens are turning to Snapchat’s ’My AI’ for mental health support — which doctors warn against. https://www.foxnews.com/health/teens-turning-my-ai-mental-health-support-which-doctors-warn-against
  39. “A Great Way to Start the Conversation”: Evidence for the Use of an Adolescent Mental Health Chatbot Navigator for Youth at Risk of HIV and Other STIs. Journal of Technology in Behavioral Science (2023), 1–10.
  40. Conversational agents in health care: scoping review and conceptual analysis. Journal of medical Internet research 22, 8 (2020), e17158.
  41. An artificial intelligence chatbot for young people’s sexual and reproductive health in india (snehai): Instrumental case study. Journal of Medical Internet Research 24, 1 (2022), e29969.
  42. 21-day stress detox: open trial of a universal well-being chatbot for young adults. Social Sciences 10, 11 (2021), 416.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Jinkyung Park (4 papers)
  2. Vivek Singh (37 papers)
  3. Pamela Wisniewski (24 papers)