Investigating the Generalizability of Physiological Characteristics of Anxiety (2402.15513v1)
Abstract: Recent works have demonstrated the effectiveness of ML techniques in detecting anxiety and stress using physiological signals, but it is unclear whether ML models are learning physiological features specific to stress. To address this ambiguity, we evaluated the generalizability of physiological features that have been shown to be correlated with anxiety and stress to high-arousal emotions. Specifically, we examine features extracted from electrocardiogram (ECG) and electrodermal (EDA) signals from the following three datasets: Anxiety Phases Dataset (APD), Wearable Stress and Affect Detection (WESAD), and the Continuously Annotated Signals of Emotion (CASE) dataset. We aim to understand whether these features are specific to anxiety or general to other high-arousal emotions through a statistical regression analysis, in addition to a within-corpus, cross-corpus, and leave-one-corpus-out cross-validation across instances of stress and arousal. We used the following classifiers: Support Vector Machines, LightGBM, Random Forest, XGBoost, and an ensemble of the aforementioned models. We found that models trained on an arousal dataset perform relatively well on a previously unseen stress dataset, and vice versa. Our experimental results suggest that the evaluated models may be identifying emotional arousal instead of stress. This work is the first cross-corpus evaluation across stress and arousal from ECG and EDA signals, contributing new findings about the generalizability of stress detection.
- N. Schneiderman, G. Ironson, and S. D. Siegel, “Stress and health: Psychological, behavioral, and biological determinants,” Annual Review of Clinical Psychology, vol. 1, no. 1, p. 607–628, 2005.
- A. Mariotti, “The effects of chronic stress on health: New insights into the molecular mechanisms of brain–body communication,” Future Science OA, vol. 1, no. 3, 2015.
- “What is Stress - Stress in America 2022,” Mar 2022. [Online]. Available: https://www.stress.org/daily-life
- “Mental Health and COVID-19 2021 Data,” 2021. [Online]. Available: https://mhanational.org/mental-health-and-covid-19-april-2022-data
- N. Daviu, M. R. Bruchas, B. Moghaddam, C. Sandi, and A. Beyelere, “Neurobiological links between stress and anxiety,” Neurobiology of Stress, vol. 11, 2019.
- B. Schuller, Z. Zhang, F. Weninger, and G. Rigoll, “Using multiple databases for training in emotion recognition: To unite or to vote?” 08 2011, pp. 1553–1556.
- W. Zehra, A. R. Javed, Z. Jalil, H. U. Khan, and T. R. Gadekallu, “Cross corpus multi-lingual speech emotion recognition using ensemble learning,” Complex & Intelligent Systems, vol. 7, no. 4, p. 1845–1854, 2021.
- Z. Zhang, F. Weninger, M. Wöllmer, and B. Schuller, “Unsupervised learning in cross-corpus acoustic emotion recognition,” in 2011 IEEE Workshop on Automatic Speech Recognition & Understanding, 2011, pp. 523–528.
- J. A. Russell, “A circumplex model of affect,” Journal of Personality and Social Psychology, vol. 39, no. 6, pp. 1161–1178, 1980.
- H. Senaratne, L. Kuhlmann, K. Ellis, G. Melvin, and S. Oviatt, “A multimodal dataset and evaluation for feature estimators of temporal phases of anxiety.” New York, NY, USA: Association for Computing Machinery, 2021. [Online]. Available: https://doi.org/10.1145/3462244.3479900
- P. Schmidt, A. Reiss, R. Duerichen, C. Marberger, and K. Van Laerhoven, “Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection.” New York, NY, USA: Association for Computing Machinery, 2018. [Online]. Available: https://doi.org/10.1145/3242969.3242985
- K. Sharma, C. Castellini, E. L. van den Broek, A. Albu-Schaeffer, and F. Schwenker, “A dataset of continuous affect annotations and physiological signals for emotion analysis,” Scientific Data, 2019.
- J. Posner, J. A. Russell, and B. S. Peterson, “The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology,” Development and Psychopathology, 2005.
- F. D’Hondt, M. Lassonde, O. Collignon, A.-S. Dubarry, M. Robert, S. Rigoulot, J. Honore, F. Lepore, and H. Sequeira, “Early brain-body impact of emotional arousal,” Frontiers in Human Neuroscience, 2010.
- J. M. Cisler, B. O. Olatunji, M. T. Feldner, and J. P. Forsyth, “Emotion regulation and the anxiety disorders: An integrative review,” Mar 2010. [Online]. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2901125/
- M. Alvord and R. Halfond, “What’s the difference between stress and anxiety?” Oct 2019. [Online]. Available: https://www.apa.org/topics/stress/anxiety-difference
- G. Vos, K. Trinh, Z. Sarnyai, and M. R. Azghadi, “Generalizable machine learning for stress monitoring from wearable devices: A systematic literature review,” Feb 2023. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1386505623000436
- A. Sepúlveda, F. Castillo, C. Palma, and M. Rodriguez-Fernandez, “Emotion recognition from ECG signals using wavelet scattering and machine learning,” May 2021. [Online]. Available: https://www.mdpi.com/2076-3417/11/11/4945
- N. Ali, H. Tschenett, and U. M. Nater, “Biomarkers of stress and disease,” Dec 2022. [Online]. Available: https://www.sciencedirect.com/science/article/abs/pii/B9780323914970002319
- P. Bobade and M. Vani, “Stress Detection with Machine Learning and Deep Learning using Multimodal Physiological Data,” in 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA), 2020, pp. 51–57.
- L. Zhu, P. Spachos, and S. Gregori, “Multimodal Physiological Signals and Machine Learning for Stress Detection by Wearable Devices,” in 2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA), 2022, pp. 1–6.
- R. Kuttala, R. Subramanian, and V. R. M. Oruganti, “Multimodal Hierarchical CNN Feature Fusion for Stress Detection,” IEEE Access, vol. 11, pp. 6867–6878, 2023.
- C.-P. Bara, M. Papakostas, and R. Mihalcea, “A deep learning approach towards multimodal stress detection.” in AffCon AAAI, 2020, pp. 67–81.
- F. Albertetti, A. Simalastar, and A. Rizzotti-Kaddouri, “Stress detection with deep learning approaches using physiological signals,” in IoT Technologies for HealthCare. Springer International Publishing, 2021.
- S. Rayatdoost and M. Soleymani, “Cross-corpus EEG-based Emotion Recognition,” in 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP), 2018, pp. 1–6.
- A. Baird, A. Triantafyllopoulos, S. Zänkert, S. Ottl, L. Christ, L. Stappen, J. Konzok, S. Sturmbauer, E.-M. Meßner, B. M. Kudielka, N. Rohleder, H. Baumeister, and B. W. Schuller, “An Evaluation of Speech-Based Recognition of Emotional and Physiological Markers of Stress,” Frontiers in Computer Science, vol. 3, 2021. [Online]. Available: https://www.frontiersin.org/articles/10.3389/fcomp.2021.750284
- “Subjective units of distress scale.” p. 361, 2015.
- R. G. Heimberg, K. J. Horner, H. R. Juster, S. A. Safren, E. J. Brown, F. R. Schneir, and M. R. Liebowitz, “Psychometric properties of the liebowitz social anxiety scale,” Psychological Medicine, vol. 29, no. 1, p. 199–212, 1999.
- C. Kirschbaum, K.-M. Pirke, and D. H. Hellhammer, “The ‘trier social stress test’ – a tool for investigating psychobiological stress responses in a laboratory setting,” Neuropsychobiology, vol. 28, no. 1–2, p. 76–81, 1993.
- D. Watson, L. A. Clark, and A. Tellegen, “Development and validation of brief measures of positive and negative affect: The PANAS scales.” Journal of Personality and Social Psychology, vol. 54, no. 6, p. 1063–1070, 1988.
- B. M. Barker, H. R. Barker Jr., and A. P. Wadsworth Jr., “Factor analysis of the items of the state-trait anxiety inventory,” Journal of Clinical Psychology, vol. 33, no. 2, pp. 450–455, 1977.
- M. M. Bradley and P. J. Lang, “Measuring emotion: The self-assessment manikin and the semantic differential,” Journal of Behavior Therapy and Experimental Psychiatry, vol. 25, no. 1, pp. 49–59, 1994. [Online]. Available: https://www.sciencedirect.com/science/article/pii/0005791694900639
- W. S. Helton, “Validation of a short stress state questionnaire,” Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 48, no. 11, pp. 1238–1242, 2004. [Online]. Available: https://doi.org/10.1177/154193120404801107
- K. Sharma, C. Castellini, F. Stulp, and E. L. van den Broek, “Continuous, real-time emotion annotation: A novel joystick-based analysis framework,” IEEE Transactions on Affective Computing, vol. 11, no. 1, pp. 78–84, 2020.
- J. Lin, S. Pan, C. S. Lee, and S. Oviatt, “An Explainable Deep Fusion Network for Affect Recognition Using Physiological Signals,” in Proceedings of the 28th ACM International Conference on Information and Knowledge Management. Association for Computing Machinery, 2019, p. 2069–2072. [Online]. Available: https://doi.org/10.1145/3357384.3358160
- C. Carreiras, A. P. Alves, A. Lourenço, F. Canento, H. Silva, A. Fred et al., “BioSPPy: Biosignal processing in Python,” 2015–, [Online; accessed ¡today¿]. [Online]. Available: https://github.com/PIA-Group/BioSPPy/
- D. Makowski, T. Pham, Z. J. Lau, J. C. Brammer, F. Lespinasse, H. Pham, C. Schölzel, and S. H. A. Chen, “NeuroKit2: A python toolbox for neurophysiological signal processing,” Behavior Research Methods, vol. 53, no. 4, pp. 168–1696, feb 2021. [Online]. Available: https://doi.org/10.3758%2Fs13428-020-01516-y
- R. Fang, R. Zhang, E. Hosseini, A. M. Parenteau, S. Hang, S. Rafatirad, C. E. Hostinar, M. Orooji, and H. Homayoun, “Prevent over-fitting and redundancy in physiological signal analyses for stress detection,” in 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 2022, pp. 2585–2588.
- J. Noteboom, K. Barnholt, and R. Enoka, “Activation of the arousal response and impairment of performance increase with anxiety and stressor intensity,” 2001. [Online]. Available: https://pubmed.ncbi.nlm.nih.gov/11641349/
- S. D. Kreibig, “Autonomic nervous system activity in emotion: A review,” Apr 2010. [Online]. Available: https://www.sciencedirect.com/science/article/abs/pii/S0301051110000827
- F. Shaffer and J. P. Ginsberg, “An overview of heart rate variability metrics and norms,” Sep 2017. [Online]. Available: https://www.frontiersin.org/articles/10.3389/fpubh.2017.00258/full
- C. Licht, E. de Geus, R. van Dyck, and P. BW, “Association between anxiety disorders and heart rate variability in the netherlands study of depression and anxiety (nesda),” 2009. [Online]. Available: https://pubmed.ncbi.nlm.nih.gov/19414616/
- J. A. Chalmers, D. S. Quintana, M. J.-A. Abbott, and A. H. Kemp, “Anxiety disorders are associated with reduced heart rate variability: A meta-analysis,” Jul 2014. [Online]. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4092363/
- P. Gomes, P. Margaritoff, and H. Silva, “pyHRV: Development and evaluation of an open-source python toolbox for heart rate variability (HRV),” in Proc. Int’l Conf. on Electrical, Electronic and Computing Engineering (IcETRAN), 2019, pp. 822–828.
- M. Pagani, N. Montano, A. Porta, A. Malliani, F. M. Abboud, C. Birkett, and V. K. Somers, “Relationship between spectral components of cardiovascular variabilities and direct measures of muscle sympathetic nerve activity in humans,” Circulation, vol. 95, no. 6, pp. 1441–1448, 1997. [Online]. Available: https://www.ahajournals.org/doi/abs/10.1161/01.CIR.95.6.1441
- M. G. Craske, A. M. Waters, E. M. Ornitz, H. Negoro, O. V. Lipp, B. Naliboff, and L. R. Bergman, “”is aversive learning a marker of risk for anxiety disorders in children?”,” pp. 954–967, 2008. [Online]. Available: ”https://doi.org/10.1016/j.brat.2008.04.011”
- T. M. Marteau and H. Bekker, “The development of a six-item short-form of the state scale of the spielberger state—trait anxiety inventory (stai),” The British journal of clinical psychology, vol. 31, no. 3, pp. 301–306, 1992. [Online]. Available: https://doi.org/10.1111/j.2044-8260.1992.tb00997.x
- S. Seabold and J. Perktold, “statsmodels: Econometric and statistical modeling with python,” in 9th Python in Science Conference, 2010.
- H. Zhang, S. Si, and C.-J. Hsieh, “Gpu-acceleration for large-scale tree boosting,” 2017.
- N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, “SMOTE: synthetic minority over-sampling technique,” Journal of Artificial Intelligence Research, vol. 16, pp. 321–357, 2002.
- H. Leng, Y. Lin, and L. A. Zanzi, “An experimental study on physiological parameters toward driver emotion recognition,” in Ergonomics and Health Aspects of Work with Computers. Berlin, Heidelberg: Springer Berlin Heidelberg, 2007, pp. 237–246.
- Emily Zhou (6 papers)
- Mohammad Soleymani (53 papers)
- Maja J. Matarić (27 papers)