Deep Reinforcement Learning Empowered Activity-Aware Dynamic Health Monitoring Systems (2401.10794v1)
Abstract: In smart healthcare, health monitoring utilizes diverse tools and technologies to analyze patients' real-time biosignal data, enabling immediate actions and interventions. Existing monitoring approaches were designed on the premise that medical devices track several health metrics concurrently, tailored to their designated functional scope. This means that they report all relevant health values within that scope, which can result in excess resource use and the gathering of extraneous data due to monitoring irrelevant health metrics. In this context, we propose Dynamic Activity-Aware Health Monitoring strategy (DActAHM) for striking a balance between optimal monitoring performance and cost efficiency, a novel framework based on Deep Reinforcement Learning (DRL) and SlowFast Model to ensure precise monitoring based on users' activities. Specifically, with the SlowFast Model, DActAHM efficiently identifies individual activities and captures these results for enhanced processing. Subsequently, DActAHM refines health metric monitoring in response to the identified activity by incorporating a DRL framework. Extensive experiments comparing DActAHM against three state-of-the-art approaches demonstrate it achieves 27.3% higher gain than the best-performing baseline that fixes monitoring actions over timeline.
- T. M. Ghazal, M. K. Hasan, M. T. Alshurideh, H. M. Alzoubi, M. Ahmad, S. S. Akbar, B. Al Kurdi, and I. A. Akour, “Iot for smart cities: Machine learning approaches in smart healthcare—a review,” Future Internet, vol. 13, no. 8, p. 218, 2021.
- H. Mora, D. Gil, R. Munoz Terol, J. Azorín, and J. Szymanski, “An iot-based computational framework for healthcare monitoring in mobile environments,” Sensors, vol. 17, no. 10, p. 2302, 2017.
- X. Wu, C. Liu, L. Wang, and M. Bilal, “Internet of things-enabled real-time health monitoring system using deep learning,” Neural Computing and Applications, pp. 1–12, 2021.
- P. Verma, R. Tiwari, W.-C. Hong, S. Upadhyay, and Y.-H. Yeh, “Fetch: a deep learning-based fog computing and iot integrated environment for healthcare monitoring and diagnosis,” IEEE Access, vol. 10, pp. 12548–12563, 2022.
- A. Gupta and V. K. Chaurasiya, “Reinforcement learning based energy management in wireless body area network: A survey,” in 2019 IEEE Conference on Information and Communication Technology, pp. 1–6, IEEE, 2019.
- C. Yu, J. Liu, S. Nemati, and G. Yin, “Reinforcement learning in healthcare: A survey,” ACM Computing Surveys (CSUR), vol. 55, no. 1, pp. 1–36, 2021.
- T. Zhu, K. Li, P. Herrero, and P. Georgiou, “Basal glucose control in type 1 diabetes using deep reinforcement learning: An in silico validation,” IEEE Journal of Biomedical and Health Informatics, vol. 25, no. 4, pp. 1223–1232, 2020.
- S. Wang, W. A. Chaovalitwongse, and S. Wong, “Online seizure prediction using an adaptive learning approach,” IEEE transactions on knowledge and data engineering, vol. 25, no. 12, pp. 2854–2866, 2013.
- A. Guez, R. D. Vincent, M. Avoli, and J. Pineau, “Adaptive treatment of epilepsy via batch-mode reinforcement learning.,” in AAAI, vol. 8, pp. 1671–1678, 2008.
- L. S. Kondaka, M. Thenmozhi, K. Vijayakumar, and R. Kohli, “An intensive healthcare monitoring paradigm by using iot based machine learning strategies,” Multimedia Tools and Applications, vol. 81, no. 26, pp. 36891–36905, 2022.
- M. Alshamrani, “Iot and artificial intelligence implementations for remote healthcare monitoring systems: A survey,” Journal of King Saud University-Computer and Information Sciences, vol. 34, no. 8, pp. 4687–4701, 2022.
- H. Fan, Y. Li, B. Xiong, W.-Y. Lo, and C. Feichtenhofer, “Pyslowfast.” https://github.com/facebookresearch/slowfast, 2020.
- S. Hijazi, A. Page, B. Kantarci, and T. Soyata, “Machine learning in cardiac health monitoring and decision support,” Computer, vol. 49, no. 11, pp. 38–48, 2016.
- T. J. Swamy and T. Murthy, “esmart: an iot based intelligent health monitoring and management system for mankind,” in 2019 International Conference on Computer Communication and Informatics (ICCCI), pp. 1–5, IEEE, 2019.
- P. Schober, C. Boer, and L. A. Schwarte, “Correlation coefficients: appropriate use and interpretation,” Anesthesia & analgesia, vol. 126, no. 5, pp. 1763–1768, 2018.
- Y. Gao, Y. Xiao, M. Wu, M. Xiao, and J. Shao, “Dynamic social-aware peer selection for cooperative relay management with d2d communications,” IEEE Transactions on Communications, vol. 67, no. 5, pp. 3124–3139, 2019.
- Y. Gao, W. Tang, M. Wu, P. Yang, and L. Dan, “Dynamic social-aware computation offloading for low-latency communications in iot,” IEEE Internet of Things Journal, vol. 6, no. 5, pp. 7864–7877, 2019.
- J. B. Awotunde, R. G. Jimoh, R. O. Ogundokun, S. Misra, and O. C. Abikoye, “Big data analytics of iot-based cloud system framework: Smart healthcare monitoring systems,” in Artificial intelligence for cloud and edge computing, pp. 181–208, Springer, 2022.
- T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra, “Continuous control with deep reinforcement learning,” arXiv preprint arXiv:1509.02971, 2015.
- Z. Ye, Y. Gao, Y. Xiao, M. Xu, H. Yu, and D. Niyato, “Cost-effective task offloading scheduling for hybrid mobile edge-quantum computing,” arXiv preprint arXiv:2306.14588, 2023.
- W. Kay, J. Carreira, K. Simonyan, B. Zhang, C. Hillier, S. Vijayanarasimhan, F. Viola, T. Green, T. Back, P. Natsev, et al., “The kinetics human action video dataset,” arXiv preprint arXiv:1705.06950, 2017.
- S. Anwer, H. Li, M. F. Antwi-Afari, W. Umer, and A. Y. L. Wong, “Evaluation of physiological metrics as real-time measurement of physical fatigue in construction workers: state-of-the-art review,” Journal of Construction Engineering and Management, vol. 147, no. 5, p. 03121001, 2021.
- S. C. Mukhopadhyay, “Wearable sensors for human activity monitoring: A review,” IEEE sensors journal, vol. 15, no. 3, pp. 1321–1330, 2014.