Papers
Topics
Authors
Recent
Search
2000 character limit reached

Design Space Exploration on Efficient and Accurate Human Pose Estimation from Sparse IMU-Sensing

Published 21 Jul 2023 in eess.SP and cs.LG | (2308.02397v2)

Abstract: Human Pose Estimation (HPE) to assess human motion in sports, rehabilitation or work safety requires accurate sensing without compromising the sensitive underlying personal data. Therefore, local processing is necessary and the limited energy budget in such systems can be addressed by Inertial Measurement Units (IMU) instead of common camera sensing. The central trade-off between accuracy and efficient use of hardware resources is rarely discussed in research. We address this trade-off by a simulative Design Space Exploration (DSE) of a varying quantity and positioning of IMU-sensors. First, we generate IMU-data from a publicly available body model dataset for different sensor configurations and train a deep learning model with this data. Additionally, we propose a combined metric to assess the accuracy-resource trade-off. We used the DSE as a tool to evaluate sensor configurations and identify beneficial ones for a specific use case. Exemplary, for a system with equal importance of accuracy and resources, we identify an optimal sensor configuration of 4 sensors with a mesh error of 6.03 cm, increasing the accuracy by 32.7% and reducing the hardware effort by two sensors compared to state of the art. Our work can be used to design health applications with well-suited sensor positioning and attention to data privacy and resource-awareness.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (15)
  1. D. Avola, L. Cinque, G. L. Foresti, and M. R. Marini, “An interactive and low-cost full body rehabilitation framework based on 3d immersive serious games,” Journal of Biomedical Informatics, vol. 89, 2019.
  2. F. Kreß, J. Hoefer, T. Hotfilter, I. Walter, V. Sidorenko, T. Harbaum, and J. Becker, “Hardware-aware partitioning of convolutional neural network inference for embedded ai applications,” in International Conference on Distributed Computing in Sensor Systems (DCOSS), 2022.
  3. J. E. van Schaik and N. Dominici, “Motion tracking in developmental research: Methods, considerations, and applications,” Progress in Brain Research, vol. 254, 2020.
  4. T. Von Marcard, B. Rosenhahn, M. J. Black, and G. Pons-Moll, “Sparse inertial poser: Automatic 3d human pose estimation from sparse imus,” in Computer Graphics Forum, vol. 36, no. 2.   Wiley Online Library, 2017.
  5. Y. Huang, M. Kaufmann, E. Aksan, M. J. Black, O. Hilliges, and G. Pons-Moll, “Deep inertial poser: Learning to reconstruct human pose from sparse inertial measurements in real time,” ACM Transactions on Graphics (TOG), vol. 37, no. 6, 2018.
  6. X. Yi, Y. Zhou, and F. Xu, “Transpose: Real-time 3d human translation and pose estimation with six inertial sensors,” ACM Transactions on Graphics (TOG), vol. 40, no. 4, 2021.
  7. X. Yi, Y. Zhou, M. Habermann, S. Shimada, V. Golyanik, C. Theobalt, and F. Xu, “Physical inertial poser (pip): Physics-aware real-time human motion tracking from sparse inertial sensors,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
  8. N. Mahmood, N. Ghorbani, N. F. Troje, G. Pons-Moll, and M. J. Black, “Amass: Archive of motion capture as surface shapes,” in IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
  9. M. Loper, N. Mahmood, J. Romero, G. Pons-Moll, and M. J. Black, “Smpl: A skinned multi-person linear model,” ACM Transactions on Graphics (TOG), vol. 34, no. 6, 2015.
  10. P. Puchert and T. Ropinski, “Human pose estimation from sparse inertial measurements through recurrent graph convolution,” in Computing Research Repository, abs/2107.11214, 2021.
  11. L. Steffan, L. Kaul, and T. Asfour, “Online stability estimation based on inertial sensor data for human and humanoid fall prevention,” in IEEE-RAS International Conference on Humanoid Robots (Humanoids), 2017.
  12. Ö. Terlemez, S. Ulbrich, C. Mandery, M. Do, N. Vahrenkamp, and T. Asfour, “Master motor map (mmm)—framework and toolkit for capturing, representing, and reproducing human motion on humanoid robots,” in IEEE-RAS International Conference on Humanoid Robots (Humanoids), 2014.
  13. C. Mandery, Ö. Terlemez, M. Do, N. Vahrenkamp, and T. Asfour, “The kit whole-body human motion database,” in IEEE International Conference on Advanced Robotics (ICAR), 2015.
  14. C. Mandery, Ö. Terlemez, M. Do, N. Vahrenkamp, and T. Asfour, “Unifying representations and large-scale whole-body motion databases for studying human motion,” IEEE Transactions on Robotics, vol. 32, no. 4, 2016.
  15. I. Patzer and T. Asfour, “Minimal sensor setup in lower limb exoskeletons for motion classification based on multi-modal sensor data,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019.
Citations (3)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.