Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Efficient Deep Learning-based Estimation of the Vital Signs on Smartphones (2204.08989v3)

Published 13 Apr 2022 in eess.SP, cs.AI, cs.CV, cs.LG, and eess.IV

Abstract: With the increasing use of smartphones in our daily lives, these devices have become capable of performing many complex tasks. Concerning the need for continuous monitoring of vital signs, especially for the elderly or those with certain types of diseases, the development of algorithms that can estimate vital signs using smartphones has attracted researchers worldwide. In particular, researchers have been exploring ways to estimate vital signs, such as heart rate, oxygen saturation levels, and respiratory rate, using algorithms that can be run on smartphones. However, many of these algorithms require multiple pre-processing steps that might introduce some implementation overheads or require the design of a couple of hand-crafted stages to obtain an optimal result. To address this issue, this research proposes a novel end-to-end solution to mobile-based vital sign estimation using deep learning that eliminates the need for pre-processing. By using a fully convolutional architecture, the proposed model has much fewer parameters and less computational complexity compared to the architectures that use fully-connected layers as the prediction heads. This also reduces the risk of overfitting. Additionally, a public dataset for vital sign estimation, which includes 62 videos collected from 35 men and 27 women, is provided. Overall, the proposed end-to-end approach promises significantly improved efficiency and performance for on-device health monitoring on readily available consumer electronics.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (30)
  1. A. T. Society, A. C. of Chest Physicians, et al., “American thoracic society/american college of chest physicians statement on cardiopulmonary exercise testing,” Am J Respir Crit Care Med, vol. 167, pp. 211–277, 2003.
  2. M. L. Vold, U. Aasebø, T. Wilsgaard, and H. Melbye, “Low oxygen saturation and mortality in an adult cohort: the tromsø study,” BMC pulmonary medicine, vol. 15, no. 1, pp. 1–12, 2015.
  3. D. K. Goyal, F. Mansab, and S. Bhatti, “Room to breathe: the impact of oxygen rationing on health outcomes in sars-cov2,” Frontiers in Medicine, vol. 7, p. 573037, 2021.
  4. C. Chourpiliadis and A. Bhardwaj, “Physiology, respiratory rate.” Updated 2022 Sep 12, 9 2022.
  5. W. Mower, C. Sachs, E. Nicklin, P. Safa, and L. Baraff, “A comparison of pulse oximetry and respiratory rate in patient screening,” Respiratory Medicine, vol. 90, no. 10, pp. 593–599, 1996.
  6. D. Castaneda, A. Esparza, M. Ghamari, C. Soltanpur, and H. Nazeran, “A review on wearable photoplethysmography sensors and their potential future applications in health care,” International journal of biosensors & bioelectronics, vol. 4, no. 4, p. 195, 2018.
  7. S. A. Siddiqui, Y. Zhang, Z. Feng, and A. Kos, “A pulse rate estimation algorithm using ppg and smartphone camera,” Journal of medical systems, vol. 40, no. 5, pp. 1–6, 2016.
  8. X. Ding, D. Nassehi, and E. C. Larson, “Measuring oxygen saturation with smartphone cameras using convolutional neural networks,” IEEE journal of biomedical and health informatics, vol. 23, no. 6, pp. 2603–2610, 2018.
  9. A. Nemcova, I. Jordanova, M. Varecka, R. Smisek, L. Marsanova, L. Smital, and M. Vitek, “Monitoring of heart rate, blood oxygen saturation, and blood pressure using a smartphone,” Biomedical Signal Processing and Control, vol. 59, p. 101928, 2020.
  10. A. H. Ayesha, D. Qiao, and F. Zulkernine, “Heart rate monitoring using ppg with smartphone camera,” in 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 2985–2991, IEEE, 2021.
  11. A. Reiss, I. Indlekofer, P. Schmidt, and K. Van Laerhoven, “Deep ppg: Large-scale heart rate estimation with convolutional neural networks,” Sensors, vol. 19, no. 14, p. 3079, 2019.
  12. A. Shyam, V. Ravichandran, S. Preejith, J. Joseph, and M. Sivaprakasam, “Ppgnet: Deep network for device independent heart rate estimation from photoplethysmogram,” in 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 1899–1902, IEEE, 2019.
  13. J. Kang, S. Yang, and W. Zhang, “Transppg: Two-stream transformer for remote heart rate estimate,” arXiv preprint arXiv:2201.10873, 2022.
  14. Z. Yang, H. Wang, and F. Lu, “Assessment of deep learning-based heart rate estimation using remote photoplethysmography under different illuminations,” IEEE Transactions on Human-Machine Systems, 2022.
  15. S. M. Salehizadeh, D. Dao, J. Bolkhovsky, C. Cho, Y. Mendelson, and K. H. Chon, “A novel time-varying spectral filtering algorithm for reconstruction of motion artifact corrupted heart rate signals during intense physical activities using a wearable photoplethysmogram sensor,” Sensors, vol. 16, no. 1, p. 10, 2015.
  16. T. Schäck, M. Muma, and A. M. Zoubir, “Computationally efficient heart rate estimation during physical exercise using photoplethysmographic signals,” in 2017 25th European Signal Processing Conference (EUSIPCO), pp. 2478–2481, IEEE, 2017.
  17. V. Bieri, P. Streli, B. U. Demirel, and C. Holz, “Beliefppg: Uncertainty-aware heart rate estimation from ppg signals via belief propagation,” arXiv preprint arXiv:2306.07730, 2023.
  18. J. S. Hoffman, V. K. Viswanath, C. Tian, X. Ding, M. J. Thompson, E. C. Larson, S. N. Patel, and E. J. Wang, “Smartphone camera oximetry in an induced hypoxemia study,” NPJ digital medicine, vol. 5, no. 1, pp. 1–10, 2022.
  19. B. Koteska, H. Mitrova, A. M. Bogdanova, and F. Lehocki, “Machine learning based spo2 prediction from ppg signal’s characteristics features,” in 2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA), pp. 1–6, IEEE, 2022.
  20. D. Jarchi, S. J. Rodgers, L. Tarassenko, and D. A. Clifton, “Accelerometry-based estimation of respiratory rate for post-intensive care patient monitoring,” IEEE Sensors Journal, vol. 18, no. 12, pp. 4981–4989, 2018.
  21. D. Bian, P. Mehta, and N. Selvaraj, “Respiratory rate estimation using ppg: A deep learning approach,” in 2020 42nd annual international conference of the IEEE engineering in Medicine & Biology Society (EMBC), pp. 5948–5952, IEEE, 2020.
  22. K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778, 2016.
  23. S. A. H. Aqajari, R. Cao, A. H. A. Zargari, and A. M. Rahmani, “An end-to-end and accurate ppg-based respiratory rate estimation approach using cycle generative adversarial networks,” in 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pp. 744–747, IEEE, 2021.
  24. M. N. I. Shuzan, M. H. Chowdhury, M. E. Chowdhury, M. Murugappan, E. Hoque Bhuiyan, M. Arslane Ayari, and A. Khandakar, “Machine learning-based respiration rate and blood oxygen saturation estimation using photoplethysmogram signals,” Bioengineering, vol. 10, no. 2, p. 167, 2023.
  25. Z. Liu, H. Mao, C.-Y. Wu, C. Feichtenhofer, T. Darrell, and S. Xie, “A convnet for the 2020s,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 11976–11986, 2022.
  26. M. A. Pimentel, A. E. Johnson, P. H. Charlton, D. Birrenkott, P. J. Watkinson, L. Tarassenko, and D. A. Clifton, “Toward a robust estimation of respiratory rate from pulse oximeters,” IEEE Transactions on Biomedical Engineering, vol. 64, no. 8, pp. 1914–1923, 2016.
  27. A. Reiss, I. Indlekofer, and P. Schmidt, “Ppg-dalia.” UCI Machine Learning Repository, 2019. DOI: https://doi.org/10.24432/C53890.
  28. M. Wilkosz and A. Szczęsna, “Multi-headed conv-lstm network for heart rate estimation during daily living activities,” Sensors, vol. 21, no. 15, p. 5212, 2021.
  29. S. B. Song, J. W. Nam, and J. H. Kim, “Nas-ppg: Ppg-based heart rate estimation using neural architecture search,” IEEE Sensors Journal, vol. 21, no. 13, pp. 14941–14949, 2021.
  30. “Tensorflow lite.” https://www.tensorflow.org/lite. Accessed: 2021-03-27.
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now