Decoding Emotional Valence from Wearables: Can Our Data Reveal Our True Feelings? (2401.05408v1)
Abstract: Automatic detection and tracking of emotional states has the potential for helping individuals with various mental health conditions. While previous studies have captured physiological signals using wearable devices in laboratory settings, providing valuable insights into the relationship between physiological responses and mental states, the transfer of these findings to real-life scenarios is still in its nascent stages. Our research aims to bridge the gap between laboratory-based studies and real-life settings by leveraging consumer-grade wearables and self-report measures. We conducted a preliminary study involving 15 healthy participants to assess the efficacy of wearables in capturing user valence in real-world settings. In this paper, we present the initial analysis of the collected data, focusing primarily on the results of valence classification. Our findings demonstrate promising results in distinguishing between high and low positive valence, achieving an F1 score of 0.65. This research opens up avenues for future research in the field of mobile mental health interventions.
- Stress detection in daily life scenarios using smart phones and wearable sensors: A survey. Journal of biomedical informatics 92 (2019), 103139.
- Continuous stress detection using wearable sensors in real life: Algorithmic programming contest case study. Sensors 19, 8 (2019), 1849.
- CogWear: Can we detect cognitive effort with consumer-grade wearables?’ (version 1.0.0). PhysioNet (2023).
- Clas: A database for cognitive load, affect and stress recognition. In 2019 International Conference on Biomedical Innovations and Applications (BIA). IEEE, 1–4.
- What Works Best to Engage Participants in Mobile App Interventions and e-Health: A Scoping Review. Telemedicine and e-Health (2021).
- K-EmoCon, a multimodal sensor dataset for continuous emotion recognition in naturalistic conversations. Scientific Data 7, 1 (2020), 293.
- Sunil Patel and Kate EA Saunders. 2018. Apps and wearables in the monitoring of mental health disorders. British Journal of Hospital Medicine 79, 12 (2018), 672–675.
- Patient and physician perspectives of a smartphone application for depression: a qualitative study. BMC psychiatry 21, 1 (2021), 1–12.
- A critical review of consumer wearables, mobile applications, and equipment for providing biofeedback, monitoring stress, and sleep in physically active populations. Frontiers in physiology 9 (2018), 743.
- Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825–2830.
- Rosalind W Picard. 2016. Automating the recognition of stress and emotion: From lab to real-world impact. IEEE MultiMedia 23, 3 (2016), 3–7.
- James A Russell. 1979. Affective space is bipolar. Journal of personality and social psychology 37, 3 (1979), 345.
- Consumer wearables and affective computing for wellbeing support. In MobiQuitous 2020-17th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services. 482–487.
- Introducing wesad, a multimodal dataset for wearable stress and affect detection. In Proceedings of the 20th ACM international conference on multimodal interaction. 400–408.
- Edmund R Thompson. 2007. Development and validation of an internationally reliable short-form of the positive and negative affect schedule (PANAS). Journal of cross-cultural psychology 38, 2 (2007), 227–242.
- Heart rate analysis for human factors: Development and validation of an open source toolkit for noisy naturalistic heart rate data. In Proceedings of the 6th HUMANIST Conference. 173–178.
- Michal K. Grzeszczyk (12 papers)
- Anna Lisowska (2 papers)
- Arkadiusz Sitek (25 papers)
- Aneta Lisowska (11 papers)