Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Personalized Prediction of Recurrent Stress Events Using Self-Supervised Learning on Multimodal Time-Series Data (2307.03337v1)

Published 7 Jul 2023 in cs.LG and eess.SP

Abstract: Chronic stress can significantly affect physical and mental health. The advent of wearable technology allows for the tracking of physiological signals, potentially leading to innovative stress prediction and intervention methods. However, challenges such as label scarcity and data heterogeneity render stress prediction difficult in practice. To counter these issues, we have developed a multimodal personalized stress prediction system using wearable biosignal data. We employ self-supervised learning (SSL) to pre-train the models on each subject's data, allowing the models to learn the baseline dynamics of the participant's biosignals prior to fine-tuning the stress prediction task. We test our model on the Wearable Stress and Affect Detection (WESAD) dataset, demonstrating that our SSL models outperform non-SSL models while utilizing less than 5% of the annotations. These results suggest that our approach can personalize stress prediction to each user with minimal annotations. This paradigm has the potential to enable personalized prediction of a variety of recurring health events using complex multimodal data streams.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (43)
  1. A novel wearable eeg and ecg recording system for stress assessment. Sensors, 19:1991, 04 2019. doi: 10.3390/s19091991.
  2. Multimodal stress detection from multiple assessments. IEEE Transactions on Affective Computing, 9(4):491–506, 2016.
  3. Deep speech 2 : End-to-end speech recognition in english and mandarin. In Balcan, M. F. and Weinberger, K. Q. (eds.), Proceedings of The 33rd International Conference on Machine Learning, volume 48 of Proceedings of Machine Learning Research, pp.  173–182, New York, New York, USA, 20–22 Jun 2016. PMLR. URL https://proceedings.mlr.press/v48/amodei16.html.
  4. A deep learning approach towards multimodal stress detection. In AffCon@ AAAI, pp.  67–81, 2020.
  5. Stress detection with machine learning and deep learning using multimodal physiological data. In 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA), pp.  51–57. IEEE, 2020.
  6. Subject-aware contrastive learning for biosignals. arXiv preprint arXiv:2007.04871, 2020.
  7. The concepts of stress and stress system disorders: overview of physical and behavioral homeostasis. Jama, 267(9):1244–1252, 1992.
  8. Psychological and physiological responses to stressful situations in immersive virtual reality: Differences between users who practice mindfulness meditation and controls. Computers in Human Behavior, 59:304–316, 2016. ISSN 0747-5632. doi: https://doi.org/10.1016/j.chb.2016.02.031. URL https://www.sciencedirect.com/science/article/pii/S0747563216300826.
  9. Feasibility testing of a wearable behavioral aid for social learning in children with autism. Applied clinical informatics, 9(01):129–140, 2018a.
  10. Exploratory study examining the at-home feasibility of a wearable tool for social-affective learning in children with autism. NPJ digital medicine, 1(1):32, 2018b.
  11. Dhabhar, F. S. Effects of stress on immune function: the good, the bad, and the beautiful. Immunologic research, 58:193–210, 2014.
  12. Mental stress detection using bioradar respiratory signals. Biomedical signal processing and control, 43:244–249, 2018.
  13. Machine learning-based signal processing using physiological signals for stress detection. In 2015 22nd Iranian Conference on Biomedical Engineering (ICBME), pp.  93–98. IEEE, 2015.
  14. Continuous stress detection using a wrist device: in laboratory and real life. pp.  1185–1193, 09 2016. doi: 10.1145/2968219.2968306.
  15. Bootstrap your own latent-a new approach to self-supervised learning. Advances in neural information processing systems, 33:21271–21284, 2020.
  16. Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. JAMA, 316(22):2402–2410, 12 2016. ISSN 0098-7484. doi: 10.1001/jama.2016.17216. URL https://doi.org/10.1001/jama.2016.17216.
  17. Publisher correction: Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network. Nature Medicine, 25(3):530–530, Mar 2019. ISSN 1546-170X. doi: 10.1038/s41591-019-0359-9. URL https://doi.org/10.1038/s41591-019-0359-9.
  18. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In 2015 IEEE International Conference on Computer Vision (ICCV), pp.  1026–1034, 2015. doi: 10.1109/ICCV.2015.123.
  19. Muse-ing on the impact of utterance ordering on crowdsourced emotion annotations. pp.  7415–7419, 05 2019. doi: 10.1109/ICASSP.2019.8682793.
  20. Labeling images with facial emotion and the potential for pediatric healthcare. Artificial intelligence in medicine, 98:77–86, 2019.
  21. Emg signal based human stress level classification using wavelet packet transform. In Ponnambalam, S. G., Parkkinen, J., and Ramanathan, K. C. (eds.), Trends in Intelligent Robotics, Automation, and Manufacturing, pp. 236–243, Berlin, Heidelberg, 2012. Springer Berlin Heidelberg. ISBN 978-3-642-35197-6.
  22. Superpower glass. GetMobile: Mobile Computing and Communications, 23(2):35–38, 2019.
  23. Deep learning. nature, 521(7553):436–444, 2015.
  24. Stress detection using deep neural networks. BMC Medical Informatics and Decision Making, 20, 12 2020. doi: 10.1186/s12911-020-01299-4.
  25. Lorig, T. S. The Respiratory System, pp.  244–257. Cambridge Handbooks in Psychology. Cambridge University Press, 4 edition, 2016. doi: 10.1017/9781107415782.011.
  26. Psychophysiological stress and emg activity of the trapezius muscle. International Journal of Behavioral Medicine, 1(4):354–370, Dec 1994. ISSN 1532-7558. doi: 10.1207/s15327558ijbm0104˙5. URL https://doi.org/10.1207/s15327558ijbm0104_5.
  27. Contrastive learning of electrodermal activity representations for stress detection. In NeurIPS 2022 Workshop on Learning from Time Series for Health, 2022. URL https://openreview.net/forum?id=bSC_xo8VQ1b.
  28. McEwen, B. S. Central effects of stress hormones in health and disease: Understanding the protective and damaging effects of stress and stress mediators. European journal of pharmacology, 583(2-3):174–185, 2008.
  29. Driver stress level detection using hrv analysis. In 2015 International Conference on Advances in Biomedical Engineering (ICABME), pp.  61–64, 2015. doi: 10.1109/ICABME.2015.7323251.
  30. Contrastive self-supervised learning for stress detection from ecg data. Bioengineering, 9(8):374, 2022.
  31. Introducing wesad, a multimodal dataset for wearable stress and affect detection. In Proceedings of the 20th ACM international conference on multimodal interaction, pp.  400–408, 2018.
  32. Influence of Mental Stress on Heart Rate and Heart Rate Variability, volume 22, pp.  1366–1369. 01 2009. ISBN 978-3-540-89207-6. doi: 10.1007/978-3-540-89208-3˙324.
  33. Effect of wearable digital intervention for improving socialization in children with autism spectrum disorder: a randomized clinical trial. JAMA pediatrics, 173(5):446–454, 2019.
  34. Employing multimodal machine learning for stress detection. Journal of Healthcare Engineering, 2021:9356452, Oct 2021. ISSN 2040-2295. doi: 10.1155/2021/9356452. URL https://doi.org/10.1155/2021/9356452.
  35. Activity and stress estimation based on openpose and electrocardiogram for user-focused level-4-vehicles. IEEE Transactions on Human-Machine Systems, 52(4):538–546, 2022. doi: 10.1109/THMS.2022.3155375.
  36. Washington, P. Crowdsourcing in precision healthcare: Short review. arXiv preprint arXiv:2303.03578, 2023.
  37. A review of and roadmap for data science and machine learning for the neuropsychiatric phenotype of autism. Annual Review of Biomedical Data Science, 6, 2023.
  38. Superpowerglass: a wearable aid for the at-home therapy of children with autism. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies, 1(3):1–22, 2017.
  39. Data-driven diagnostics and the potential of mobile artificial intelligence for digital therapeutic phenotyping in computational psychiatry. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 5(8):759–769, 2020.
  40. Challenges and opportunities for machine learning classification of behavior and mental state from images. arXiv preprint arXiv:2201.11197, 2022.
  41. Trapezius muscle emg as predictor of mental stress. volume 12, pp.  155–163, 10 2010. doi: 10.1145/2485984.2485987.
  42. Investigation on driver stress utilizing ecg signals with on-board navigation systems in use. In 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV), pp.  1–6, 2016. doi: 10.1109/ICARCV.2016.7838780.
  43. Rethinking the augmentation module in contrastive learning: Learning hierarchical augmentation invariance with expanded views. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.  16650–16659, 2022.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (2)
  1. Tanvir Islam (5 papers)
  2. Peter Washington (27 papers)
Citations (7)

Summary

We haven't generated a summary for this paper yet.