Stressor Type Matters! -- Exploring Factors Influencing Cross-Dataset Generalizability of Physiological Stress Detection (2405.09563v1)
Abstract: Automatic stress detection using heart rate variability (HRV) features has gained significant traction as it utilizes unobtrusive wearable sensors measuring signals like electrocardiogram (ECG) or blood volume pulse (BVP). However, detecting stress through such physiological signals presents a considerable challenge owing to the variations in recorded signals influenced by factors, such as perceived stress intensity and measurement devices. Consequently, stress detection models developed on one dataset may perform poorly on unseen data collected under different conditions. To address this challenge, this study explores the generalizability of machine learning models trained on HRV features for binary stress detection. Our goal extends beyond evaluating generalization performance; we aim to identify the characteristics of datasets that have the most significant influence on generalizability. We leverage four publicly available stress datasets (WESAD, SWELL-KW, ForDigitStress, VerBIO) that vary in at least one of the characteristics such as stress elicitation techniques, stress intensity, and sensor devices. Employing a cross-dataset evaluation approach, we explore which of these characteristics strongly influence model generalizability. Our findings reveal a crucial factor affecting model generalizability: stressor type. Models achieved good performance across datasets when the type of stressor (e.g., social stress in our case) remains consistent. Factors like stress intensity or brand of the measurement device had minimal impact on cross-dataset performance. Based on our findings, we recommend matching the stressor type when deploying HRV-based stress models in new environments. To the best of our knowledge, this is the first study to systematically investigate factors influencing the cross-dataset applicability of HRV-based stress models.
- Ayten Ozge Akmandor and Niraj K Jha. 2017. Keep the stress away with SoDA: Stress detection and alleviation system. IEEE Transactions on Multi-Scale Computing Systems 3, 4 (2017), 269–282.
- Evaluating different configurations of machine learning models and their transfer learning capabilities for stress detection using heart rate. Journal of Ambient Intelligence and Humanized Computing 14, 8 (2023), 11011–11021.
- Towards an automatic early stress recognition system for office environments based on multimodal measurements: A review. Journal of biomedical informatics 59 (2016), 49–75.
- An evaluation of speech-based recognition of emotional and physiological markers of stress. Frontiers in Computer Science 3 (2021), 750284.
- Luke Balcombe and Diego De Leo. 2022. Human-computer interaction in digital mental health. In Informatics, Vol. 9. MDPI, 14.
- A Multi-Modal Dataset (MMSD) for Acute Stress Bio-Markers. In International Joint Conference on Biomedical Engineering Systems and Technologies. Springer, 377–392.
- Cross dataset analysis for generalizability of HRV-based stress detection models. Sensors 23, 4 (2023), 1807.
- A non-EEG biosignals dataset for assessment and visualization of neurological status. In 2016 IEEE International Workshop on Signal Processing Systems (SiPS). IEEE, 110–114.
- Pramod Bobade and M Vani. 2020. Stress detection with machine learning and deep learning using multimodal physiological data. In 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA). IEEE, 51–57.
- A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments. Psychophysiology 49, 1 (2013), 1017–1034.
- Stress detection in daily life scenarios using smart phones and wearable sensors: A survey. Journal of biomedical informatics 92 (2019), 103139.
- Frequency Bands Effects on QRS Detection. Biosignals 2003 (2010), 2002.
- Systolic peak detection in acceleration photoplethysmograms measured from emergency responders in tropical conditions. PloS one 8, 10 (2013), e76585.
- Review on psychological stress detection using biosignals. IEEE transactions on affective computing 13, 1 (2019), 440–460.
- A survey of affective computing for stress detection: Evaluating technologies in stress detection for better health. IEEE Consumer Electronics Magazine 5, 4 (2016), 44–56.
- Multimodal Wearable Sensors-based Stress and Affective States Prediction Model. In 2023 9th International Conference on Advanced Computing and Communication Systems (ICACCS), Vol. 1. IEEE, 30–35.
- State-of-the-Art of Stress Prediction from Heart Rate Variability Using Artificial Intelligence. Cognitive Computation 16, 2 (2024), 455–481.
- ForDigitStress: A multi-modal stress dataset employing a digital job interview scenario. arXiv preprint arXiv:2303.07742 (2023).
- Detecting work stress in offices by combining unobtrusive sensors. IEEE Transactions on affective computing 9, 2 (2016), 227–239.
- The SWELL knowledge work dataset for stress and user modeling research. In Proceedings of the 16th international conference on multimodal interaction. 291–298.
- Detection of subtle stress episodes during UX evaluation: Assessing the performance of the WESAD bio-signals dataset. In Human-Computer Interaction–INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30–September 3, 2021, Proceedings, Part III 18. Springer, 238–247.
- Towards real-time recognition of users mental workload using integrated physiological sensors into a VR HMD. In 2020 IEEE international symposium on mixed and augmented reality (ISMAR). IEEE, 425–437.
- NeuroKit2: A Python toolbox for neurophysiological signal processing. Behavior research methods (2021), 1–8.
- Towards continuous user recognition by exploring physiological multimodality: An electrocardiogram (ECG) and blood volume pulse (BVP) approach. In 2018 International Symposium in Sensing and Instrumentation in IoT Era (ISSI). IEEE, 1–6.
- Evaluating the reproducibility of physiological stress detection models. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 4, 4 (2020), 1–29.
- The effect of person-specific biometrics in improving generic stress predictive models. arXiv preprint arXiv:1910.01770 (2019).
- Heart rate variability in psychology: A review of HRV indices and an analysis tutorial. Sensors 21, 12 (2021), 3998.
- Pooja Prajod and Elisabeth André. 2022. On the Generalizability of ECG-based Stress Detection Models. In 2022 21st IEEE International Conference on Machine Learning and Applications (ICMLA). IEEE, 549–554.
- Flow in Human-Robot Collaboration-Multimodal Analysis and Perceived Challenge Detection in Industrial Scenarios. Frontiers in Robotics and AI 11 ([n. d.]), 1393795.
- Ubfc-phys: A multimodal database for psychophysiological studies of social stress. IEEE Transactions on Affective Computing 14, 1 (2021), 622–636.
- Pritam Sarkar and Ali Etemad. 2020. Self-supervised ECG representation learning for emotion recognition. IEEE Transactions on Affective Computing 13, 3 (2020), 1541–1554.
- Introducing WESAD, a multimodal dataset for wearable stress and affect detection. In Proceedings of the 20th ACM international conference on multimodal interaction. 400–408.
- Towards real-time public health: a novel mobile health monitoring system. In 2021 IEEE International Conference on Big Data (Big Data). IEEE, 6049–6051.
- Ensemble machine learning model trained on a new synthesized dataset generalizes well for stress prediction using wearable devices. Journal of Biomedical Informatics 148 (2023), 104556.
- Generalizable machine learning for stress monitoring from wearable devices: a systematic literature review. International Journal of Medical Informatics 173 (2023), 105026.
- Exploring individual differences of public speaking anxiety in real-life and virtual presentations. IEEE Transactions on Affective Computing 13, 3 (2020), 1168–1182.
- Biofeedback for everyday stress management: A systematic review. Frontiers in ICT 5 (2018), 23.
- A Hybrid Approach for Stress Prediction from Heart Rate Variability. In Frontiers of ICT in Healthcare: Proceedings of EAIT 2022. Springer, 111–121.
- Pooja Prajod (11 papers)
- Bhargavi Mahesh (1 paper)
- Elisabeth André (65 papers)