Papers
Topics
Authors
Recent
Search
2000 character limit reached

iMove: Exploring Bio-impedance Sensing for Fitness Activity Recognition

Published 31 Jan 2024 in eess.SP, cs.AI, cs.LG, and cs.RO | (2402.09445v2)

Abstract: Automatic and precise fitness activity recognition can be beneficial in aspects from promoting a healthy lifestyle to personalized preventative healthcare. While IMUs are currently the prominent fitness tracking modality, through iMove, we show bio-impedence can help improve IMU-based fitness tracking through sensor fusion and contrastive learning.To evaluate our methods, we conducted an experiment including six upper body fitness activities performed by ten subjects over five days to collect synchronized data from bio-impedance across two wrists and IMU on the left wrist.The contrastive learning framework uses the two modalities to train a better IMU-only classification model, where bio-impedance is only required at the training phase, by which the average Macro F1 score with the input of a single IMU was improved by 3.22 \% reaching 84.71 \% compared to the 81.49 \% of the IMU baseline model. We have also shown how bio-impedance can improve human activity recognition (HAR) directly through sensor fusion, reaching an average Macro F1 score of 89.57 \% (two modalities required for both training and inference) even if Bio-impedance alone has an average macro F1 score of 75.36 \%, which is outperformed by IMU alone. In addition, similar results were obtained in an extended study on lower body fitness activity classification, demonstrating the generalisability of our approach.Our findings underscore the potential of sensor fusion and contrastive learning as valuable tools for advancing fitness activity recognition, with bio-impedance playing a pivotal role in augmenting the capabilities of IMU-based systems.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. R. K. Dishman, J. F. Sallis, and D. R. Orenstein, “The determinants of physical activity and exercise.” Public health reports, vol. 100, no. 2, p. 158, 1985.
  2. F. J. Penedo and J. R. Dahn, “Exercise and well-being: a review of mental and physical health benefits associated with physical activity,” Current opinion in psychiatry, vol. 18, no. 2, pp. 189–193, 2005.
  3. B. Fu, F. Kirchbuchner, and A. Kuijper, “Unconstrained workout activity recognition on unmodified commercial off-the-shelf smartphones,” in Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments, 2020, pp. 1–10.
  4. X. Guo, J. Liu, C. Shi, H. Liu, Y. Chen, and M. C. Chuah, “Device-free personalized fitness assistant using wifi,” Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 2, no. 4, pp. 1–23, 2018.
  5. B. Zhou, M. Sundholm, J. Cheng, H. Cruz, and P. Lukowicz, “Never skip leg day: A novel wearable approach to monitoring gym leg exercises,” in 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).   IEEE, 2016, pp. 1–9.
  6. S. Bian, V. F. Rey, P. Hevesi, and P. Lukowicz, “Passive capacitive based approach for full body gym workout recognition and counting,” in 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom.   IEEE, 2019, pp. 1–10.
  7. J. Qi, P. Yang, M. Hanneghan, S. Tang, and B. Zhou, “A hybrid hierarchical framework for gym physical activity recognition and measurement using wearable sensors,” IEEE Internet of Things Journal, vol. 6, no. 2, pp. 1384–1393, 2018.
  8. T. Rangari, S. Kumar, P. P. Roy, D. P. Dogra, and B.-G. Kim, “Video based exercise recognition and correct pose detection,” Multimedia Tools and Applications, vol. 81, no. 21, pp. 30 267–30 282, 2022.
  9. U. Aiman and T. Ahmad, “Video based exercise recognition using gcn,” in 2023 International Conference on Recent Advances in Electrical, Electronics & Digital Healthcare Technologies (REEDCON).   IEEE, 2023, pp. 180–184.
  10. S. Bian, M. Liu, B. Zhou, and P. Lukowicz, “The state-of-the-art sensing techniques in human activity recognition: A survey,” Sensors, vol. 22, no. 12, p. 4596, 2022.
  11. J. Karolus, F. Bachmann, T. Kosch, A. Schmidt, and P. W. Woźniak, “Facilitating bodily insights using electromyography-based biofeedback during physical activity,” in Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction, 2021, pp. 1–15.
  12. E. Piuzzi, S. Pisa, E. Pittella, L. Podestà, and S. Sangiovanni, “Low-cost and portable impedance plethysmography system for the simultaneous detection of respiratory and heart activities,” IEEE Sensors Journal, vol. 19, no. 7, pp. 2735–2746, 2018.
  13. J. Xu, X. Gao, A. Lee, S. Yamada, E. Yavari, V. Lubecke, and O. Boric-Lubecke, “Wrist-worn heartbeat monitoring system based on bio-impedance analysis,” in 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).   IEEE, 2016, pp. 6294–6297.
  14. Y. Zhang and C. Harrison, “Tomo: Wearable, low-cost electrical impedance tomography for hand gesture recognition,” in Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, 2015, pp. 167–173.
  15. H. Chen, G. Ma, P. Wang, and X. Wang, “A bio-impedance analysis method based on human hand anatomy for hand gesture recognition,” IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1–10, 2021.
  16. C. I. Tang, I. Perez-Pozuelo, D. Spathis, and C. Mascolo, “Exploring contrastive learning in human activity recognition for healthcare,” arXiv preprint arXiv:2011.11542, 2020.
  17. L. M. Roa, D. Naranjo, J. Reina-Tosina, A. Lara, J. A. Milán, M. A. Estudillo, and J. S. Oliva, “Applications of bioimpedance to end stage renal disease (esrd),” Modelling and Control of Dialysis Systems: Volume 1: Modeling Techniques of Hemodialysis Systems, pp. 689–769, 2013.
  18. K. Sel, A. Brown, H. Jang, H. M. Krumholz, N. Lu, and R. Jafari, “A wrist-worn respiration monitoring device using bio-impedance,” in 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).   IEEE, 2020, pp. 3989–3993.
  19. G. Ma, H. Chen, P. Wang, S. Dong, and X. Wang, “A two-electrode frequency-scan system for gesture recognition,” Mechatronics, vol. 94, p. 103039, 2023.
  20. R. Zhang, M. Freund, O. Amft, J. Cheng, B. Zhou, P. Lukowicz, S. Fernando, and P. Chabrecek, “A generic sensor fabric for multi-modal swallowing sensing in regular upper-body shirts,” in Proceedings of the 2016 ACM International Symposium on Wearable Computers, 2016, pp. 46–47.
  21. T. R. Ackland, T. G. Lohman, J. Sundgot-Borgen, R. J. Maughan, N. L. Meyer, A. D. Stewart, and W. Müller, “Current status of body composition assessment in sport: review and position statement on behalf of the ad hoc research working group on body composition health and performance, under the auspices of the ioc medical commission,” Sports medicine, vol. 42, pp. 227–249, 2012.
  22. T. Van Steenkiste, W. Groenendaal, P. Dreesen, S. Lee, S. Klerkx, R. de Francisco, D. Deschrijver, and T. Dhaene, “Portable detection of apnea and hypopnea events using bio-impedance of the chest and deep learning,” IEEE Journal of Biomedical and Health Informatics, vol. 24, no. 9, pp. 2589–2598, 2020.
  23. C. Holz and M. Knaust, “Biometric touch sensing: Seamlessly augmenting each touch with continuous authentication,” in Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, 2015, pp. 303–312.
  24. S. Hersek, H. Töreyin, C. N. Teague, M. L. Millard-Stafford, H.-K. Jeong, M. M. Bavare, P. Wolkoff, M. N. Sawka, and O. T. Inan, “Wearable vector electrical bioimpedance system to assess knee joint health,” IEEE Transactions on Biomedical Engineering, vol. 64, no. 10, pp. 2353–2360, 2016.
  25. G. Vescio, J. Rosell, L. Nescolarde, and G. Giovinazzo, “Muscle fatigue monitoring using a multifrequency bioimpedance technique,” in 5th European Conference of the International Federation for Medical and Biological Engineering: 14–18 September 2011, Budapest, Hungary.   Springer, 2012, pp. 1257–1260.
  26. A. A. Aguileta, R. F. Brena, O. Mayora, E. Molino-Minero-Re, and L. A. Trejo, “Multi-sensor fusion for activity recognition—a survey,” Sensors, vol. 19, no. 17, p. 3808, 2019.
  27. S. Münzner, P. Schmidt, A. Reiss, M. Hanselmann, R. Stiefelhagen, and R. Dürichen, “Cnn-based sensor fusion techniques for multimodal human activity recognition,” in Proceedings of the 2017 ACM international symposium on wearable computers, 2017, pp. 158–165.
  28. J.-H. Choi and J.-S. Lee, “Confidence-based deep multimodal fusion for activity recognition,” in Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, 2018, pp. 1548–1556.
  29. S. Liu, S. Yao, J. Li, D. Liu, T. Wang, H. Shao, and T. Abdelzaher, “Giobalfusion: A global attentional deep learning framework for multisensor information fusion,” Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 4, no. 1, pp. 1–27, 2020.
  30. Y. Zhou, H. Zhao, Y. Huang, T. Riedel, M. Hefenbrock, and M. Beigl, “Tinyhar: A lightweight deep learning model designed for human activity recognition,” in Proceedings of the 2022 ACM International Symposium on Wearable Computers, 2022, pp. 89–93.
  31. R. Gravina, P. Alinia, H. Ghasemzadeh, and G. Fortino, “Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges,” Information Fusion, vol. 35, pp. 68–80, 2017.
  32. V. Fortes Rey, S. Suh, and P. Lukowicz, “Learning from the best: Contrastive representations learning across sensor locations for wearable activity recognition,” in Proceedings of the 2022 ACM International Symposium on Wearable Computers, 2022, pp. 28–32.
  33. P. Lago, M. Matsuki, K. Adachi, and S. Inoue, “Using additional training sensors to improve single-sensor complex activity recognition,” in Proceedings of the 2021 ACM International Symposium on Wearable Computers, 2021, pp. 18–22.
  34. H. Yang, H. Yu, K. Sridhar, T. Vaessen, I. Myin-Germeys, and A. Sano, “More to less (m2l): Enhanced health recognition in the wild with reduced modality of wearable sensors,” in 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).   IEEE, 2022, pp. 3253–3256.
  35. D. Naranjo-Hernández, J. Reina-Tosina, and M. Min, “Fundamentals, recent advances, and future challenges in bioimpedance devices for healthcare applications,” Journal of Sensors, vol. 2019, 2019.
  36. A. Cömert and J. Hyttinen, “Impedance spectroscopy of changes in skin-electrode impedance induced by motion,” BioMedical Engineering OnLine, vol. 13, no. 1, pp. 1–19, 2014.
  37. A. v. d. Oord, Y. Li, and O. Vinyals, “Representation learning with contrastive predictive coding,” arXiv preprint arXiv:1807.03748, 2018.
Citations (5)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up