Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Contextual AI Journaling: Integrating LLM and Time Series Behavioral Sensing Technology to Promote Self-Reflection and Well-being using the MindScape App (2404.00487v1)

Published 30 Mar 2024 in cs.HC and cs.AI

Abstract: MindScape aims to study the benefits of integrating time series behavioral patterns (e.g., conversational engagement, sleep, location) with LLMs to create a new form of contextual AI journaling, promoting self-reflection and well-being. We argue that integrating behavioral sensing in LLMs will likely lead to a new frontier in AI. In this Late-Breaking Work paper, we discuss the MindScape contextual journal App design that uses LLMs and behavioral sensing to generate contextual and personalized journaling prompts crafted to encourage self-reflection and emotional development. We also discuss the MindScape study of college students based on a preliminary user study and our upcoming study to assess the effectiveness of contextual AI journaling in promoting better well-being on college campuses. MindScape represents a new application class that embeds behavioral intelligence in AI.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (51)
  1. Dorit Alt and Nirit Raichel. 2020. Reflective journaling and metacognitive awareness: Insights from a longitudinal study in higher education. Reflective Practice 21, 2 (2020), 145–158.
  2. Apple. 2024. Get started with Journal on iPhone. https://support.apple.com/guide/iphone/get-started-with-journal-iph0e5ca7dd3/ios
  3. Louise Aronson. 2010. Twelve tips for teaching reflection at all levels of medical education. Medical Teacher 33, 3 (Sept. 2010), 200–205. https://doi.org/10.3109/0142159x.2010.507714
  4. American College Health Association. 2024. American College Health Association-National College Health Assessment III: Reference Group Executive Summary Spring 2023. https://www.acha.org/documents/ncha/NCHA-III_SPRING_2023_REFERENCE_GROUP_EXECUTIVE_SUMMARY.pdf
  5. Using self-report assessment methods to explore facets of mindfulness. Assessment 13, 1 (2006), 27–45.
  6. David Bakker and Nikki Rickard. 2018. Engagement in mobile phone app for self-monitoring of emotional wellbeing predicts changes in mental health: MoodPrism. Journal of Affective Disorders 227 (Feb. 2018), 432–442. https://doi.org/10.1016/j.jad.2017.11.016
  7. The prevalence and correlates of depression, anxiety, and stress in a sample of college students. Journal of affective disorders 173 (2015), 90–96.
  8. Herbert Benson and Eileen M Stuart. 1993. The wellness book: The comprehensive guide to maintaining health and treating stress-related illness. Simon and Schuster.
  9. Integrating Individual and Social Contexts into Self-Reflection Technologies. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, Article 356, 6 pages. https://doi.org/10.1145/3544549.3573803
  10. Understanding the Role of Large Language Models in Personalizing and Scaffolding Strategies to Combat Academic Procrastination. arXiv preprint arXiv:2312.13581 (2023).
  11. R Biswas-Diener. 2009. New measures of well-being: Flourishing and positive and negative feelings. Social Indicators Research 39 (2009), 247–266.
  12. Canan Cengiz. 2020. The effect of structured journals on reflection levels: With or without question prompts? Australian Journal of Teacher Education (Online) 45, 2 (2020), 23–43.
  13. Effects of high level prompts and peer assessment on online learners’ reflection levels. Computers & Education 52, 2 (Feb. 2009), 283–291. https://doi.org/10.1016/j.compedu.2008.08.007
  14. A Computational Framework for Behavioral Assessment of LLM Therapists. arXiv preprint arXiv:2401.00820 (2024).
  15. Reflection in Theory and Reflection in Practice: An Exploration of the Gaps in Reflection Support among Personal Informatics Apps. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 142, 23 pages. https://doi.org/10.1145/3491102.3501991
  16. Leah R Dickens. 2017. Using gratitude to promote positive change: A series of meta-analyses investigating the effectiveness of gratitude interventions. Basic and Applied Social Psychology 39, 4 (2017), 193–208.
  17. Change your life through journaling–The benefits of journaling for registered nurses. Journal of Nursing Education and Practice 7, 2 (Oct. 2016). https://doi.org/10.5430/jnep.v7n2p90
  18. Alessio Ferrara. 2022. Empowering emotional well-being through a LLM-based chatbot: a comparative study with the standard journaling technique. (2022).
  19. Xun Ge and Susan M. Land. 2003. Scaffolding students’ problem-solving processes in an ill-structured task using question prompts and peer interactions. Educational Technology Research and Development 51, 1 (March 2003), 21–38. https://doi.org/10.1007/bf02504515
  20. Activation of Learning Strategies in Writing Learning Journals: The Specificity of Prompts Matters. Zeitschrift für Pädagogische Psychologie 23, 2 (Jan. 2009), 95–104. https://doi.org/10.1024/1010-0652.23.2.95
  21. James J Gross and Oliver P John. 2003. Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being. Journal of personality and social psychology 85, 2 (2003), 348.
  22. Social and emotional learning in the classroom: Promoting mental health and academic success. Guilford Publications.
  23. Large Language Models in Mental Health Care: a Scoping Review. arXiv preprint arXiv:2401.02984 (2024).
  24. Karsen N Keech and Patricia G Coberly-Holt. 2021. Journaling for Mental Health. In Strategies and Tactics for Multidisciplinary Writing. IGI Global, 39–44.
  25. Can an LLM-Powered Socially Assistive Robot Effectively and Safely Deliver Cognitive Behavioral Therapy? A Study With University Students. arXiv preprint arXiv:2402.17937 (2024).
  26. MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients’ Journaling. arXiv preprint arXiv:2310.05231 (2023).
  27. DiaryMate: Exploring the Roles of Large Language Models in Facilitating AI-mediated Journaling. (2024).
  28. Reflection Companion: A Conversational System for Engaging Users in Reflection on Physical Activity. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (July 2018), 1–26. https://doi.org/10.1145/3214273
  29. Exploring the use of large language models for improving the awareness of mindfulness. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–7.
  30. Exploring Design Opportunities for Reflective Conversational Agents to Reduce Compulsive Smartphone Use. In Proceedings of the 5th International Conference on Conversational User Interfaces (Eindhoven, Netherlands) (CUI ’23). Association for Computing Machinery, New York, NY, USA, Article 37, 6 pages. https://doi.org/10.1145/3571884.3604305
  31. The potential of generative AI for personalized persuasion at scale. Scientific Reports 14, 1 (2024), 4692.
  32. William Miller. 2014. Interactive journaling as a clinical tool. Journal of Mental Health Counseling 36, 1 (2014), 31–42.
  33. Mohammad Mofatteh. 2021. Risk factors associated with stress, anxiety, and depression among university undergraduate students. AIMS public health 8, 1 (2021), 36.
  34. A Comprehensive Overview of Large Language Models. arXiv preprint arXiv:2307.06435 (2023).
  35. Capturing the College Experience: A Four-Year Mobile Sensing Study of Mental Health, Resilience and Behavior of College Students during the Pandemic. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 8, 1, Article 38 (mar 2024), 37 pages. https://doi.org/10.1145/3643501
  36. LLM-based Conversational AI Therapist for Daily Functioning Screening and Psychotherapeutic Intervention via Everyday Smart Devices. arXiv preprint arXiv:2403.10779 (2024).
  37. OpenAI. 2023. GPT-4 Technical Report. arXiv:2303.08774 [cs.CL]
  38. OpenAI. 2024. OpenAI. https://openai.com
  39. Qualitative Research Studies Online: Using Prompted Weekly Journal Entries During the COVID-19 Pandemic. International Journal of Qualitative Methods 21 (Jan. 2022), 160940692210931. https://doi.org/10.1177/16094069221093138
  40. Carol D Ryff and Corey Lee M Keyes. 1995. The structure of psychological well-being revisited. Journal of personality and social psychology 69, 4 (1995), 719.
  41. Facilitating self-guided mental health interventions through human-language model interaction: A case study of cognitive restructuring. arXiv preprint arXiv:2310.15461 (2023).
  42. Online Positive Affect Journaling in the Improvement of Mental Distress and Well-Being in General Medical Patients With Elevated Anxiety Symptoms: A Preliminary Randomized Controlled Trial. JMIR Mental Health 5, 4 (Dec. 2018), e11290. https://doi.org/10.2196/11290
  43. Efficacy of journaling in the management of mental illness: a systematic review and meta-analysis. Family medicine and community health 10, 1 (2022).
  44. Bryce E Stoliker and Kathryn D Lafreniere. 2015. The influence of perceived stress, loneliness, and learning burnout on university students’ educational experience. College student journal 49, 1 (2015), 146–160.
  45. Personality and psychopathology of university students. Current opinion in psychiatry 23, 1 (2010), 48–52.
  46. First-gen lens: Assessing mental health of first-generation students across their first year at college using mobile sensing. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 6, 2 (2022), 1–32.
  47. Reflective journaling: Innovative strategy for self-awareness for graduate nursing students. International Journal of Human Caring 13, 3 (2009), 36–43.
  48. MindShift: Leveraging Large Language Models for Mental-States-Based Problematic Smartphone Use Intervention. https://doi.org/10.48550/ARXIV.2309.16639
  49. Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 8, 1, Article 31 (mar 2024), 32 pages. https://doi.org/10.1145/3643540
  50. Help Me Reflect: Leveraging Self-Reflection Interface Nudges to Enhance Deliberativeness on Online Deliberation Platforms. arXiv preprint arXiv:2401.10820 (2024).
  51. How Breath-Control Can Change Your Life: A Systematic Review on Psycho-Physiological Correlates of Slow Breathing. Frontiers in Human Neuroscience 12 (Sept. 2018). https://doi.org/10.3389/fnhum.2018.00353
Citations (7)

Summary

  • The paper demonstrates how integrating LLMs with time-series behavioral sensing in the MindScape app enables dynamic, context-aware journaling for self-reflection.
  • It employs passively captured data from mobile sensors to generate personalized prompts that align with user activities and behaviors.
  • The study shows promising implications for enhancing mental well-being and advancing human-computer interaction through AI-driven interventions.

Integrating Behavioral Sensing and LLMs in AI Journaling for Mental Well-being: A Study with the MindScape App

The paper examines the potential of combining LLMs with time-series behavioral sensing technologies to enhance self-reflection and well-being through contextual journaling using the MindScape app. The research primarily targets college students, acknowledging the significant mental health challenges prevalent within this demographic, as it leverages ubiquitous computing to integrate AI and behavioral intelligence into daily journaling practices.

The central thesis argues for an innovative application paradigm where AI applications, particularly those driven by mobile sensing, are enhanced through the seamless integration of time-series data. The application, aptly named MindScape, utilizes Android device sensors to capture user data, which includes metrics related to physical activity, social interactions, and location. The data acts as a foundation for generating personalized journaling prompts via LLMs, aiming to mitigate the introspective and memory recall limitations often encountered during self-reflection.

The researchers have conducted an exploratory qualitative paper with undergraduate participants to gauge typical journaling habits and the reception of context-sensitive prompts. According to the users' feedback, students expressed preferences for customized prompts that align with their digital engagement and daily experiences. These insights significantly influenced the app's design, ensuring the journaling experience is tailored to reflect individual behavioral contexts, ultimately enhancing potential positive mental health outcomes.

A salient aspect of their methodology includes the deployment of context-aware check-ins facilitated by a semantic map of campus locations and LLM-generated personalized prompts. This bi-directional relationship encourages not only introspection during journaling but also immediate, short-form reflection through timely behavioral nudges. Emotional regulation, self-awareness, and mindfulness form the core dimensions assessed by standardized questionnaires to capture the app’s impact accurately.

The implications of this paper are twofold, affecting both practical and theoretical dimensions of human-computer interaction (HCI) and AI development. Practically, the research highlights how context-aware journaling engineered through LLMs and passive mobile sensing can adapt to and support the fast-paced environments typical in collegiate settings. Theoretically, it signifies a push towards a new genre of AI, one that is intricately woven into user behaviors and attitudes, offering real-time, personalized mental health support.

Moving forward, the scalability of integrating AI with behavioral data offers substantial potential for personalized digital mental health interventions beyond academia. Expanding upon these methodologies, future research could explore scalability and further integration with more advanced multimodal data sources, potentially enabling broader deployment across diverse populations and settings. As AI continues to evolve, fostering applications that facilitate reflective practices supports the dual aims of advancing technological capacities and enhancing user well-being, thus sustaining the broader dialogue within the HCI and UbiComp communities.

X Twitter Logo Streamline Icon: https://streamlinehq.com