Design Space Exploration on Efficient and Accurate Human Pose Estimation from Sparse IMU-Sensing
Abstract: Human Pose Estimation (HPE) to assess human motion in sports, rehabilitation or work safety requires accurate sensing without compromising the sensitive underlying personal data. Therefore, local processing is necessary and the limited energy budget in such systems can be addressed by Inertial Measurement Units (IMU) instead of common camera sensing. The central trade-off between accuracy and efficient use of hardware resources is rarely discussed in research. We address this trade-off by a simulative Design Space Exploration (DSE) of a varying quantity and positioning of IMU-sensors. First, we generate IMU-data from a publicly available body model dataset for different sensor configurations and train a deep learning model with this data. Additionally, we propose a combined metric to assess the accuracy-resource trade-off. We used the DSE as a tool to evaluate sensor configurations and identify beneficial ones for a specific use case. Exemplary, for a system with equal importance of accuracy and resources, we identify an optimal sensor configuration of 4 sensors with a mesh error of 6.03 cm, increasing the accuracy by 32.7% and reducing the hardware effort by two sensors compared to state of the art. Our work can be used to design health applications with well-suited sensor positioning and attention to data privacy and resource-awareness.
- D. Avola, L. Cinque, G. L. Foresti, and M. R. Marini, “An interactive and low-cost full body rehabilitation framework based on 3d immersive serious games,” Journal of Biomedical Informatics, vol. 89, 2019.
- F. Kreß, J. Hoefer, T. Hotfilter, I. Walter, V. Sidorenko, T. Harbaum, and J. Becker, “Hardware-aware partitioning of convolutional neural network inference for embedded ai applications,” in International Conference on Distributed Computing in Sensor Systems (DCOSS), 2022.
- J. E. van Schaik and N. Dominici, “Motion tracking in developmental research: Methods, considerations, and applications,” Progress in Brain Research, vol. 254, 2020.
- T. Von Marcard, B. Rosenhahn, M. J. Black, and G. Pons-Moll, “Sparse inertial poser: Automatic 3d human pose estimation from sparse imus,” in Computer Graphics Forum, vol. 36, no. 2. Wiley Online Library, 2017.
- Y. Huang, M. Kaufmann, E. Aksan, M. J. Black, O. Hilliges, and G. Pons-Moll, “Deep inertial poser: Learning to reconstruct human pose from sparse inertial measurements in real time,” ACM Transactions on Graphics (TOG), vol. 37, no. 6, 2018.
- X. Yi, Y. Zhou, and F. Xu, “Transpose: Real-time 3d human translation and pose estimation with six inertial sensors,” ACM Transactions on Graphics (TOG), vol. 40, no. 4, 2021.
- X. Yi, Y. Zhou, M. Habermann, S. Shimada, V. Golyanik, C. Theobalt, and F. Xu, “Physical inertial poser (pip): Physics-aware real-time human motion tracking from sparse inertial sensors,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
- N. Mahmood, N. Ghorbani, N. F. Troje, G. Pons-Moll, and M. J. Black, “Amass: Archive of motion capture as surface shapes,” in IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
- M. Loper, N. Mahmood, J. Romero, G. Pons-Moll, and M. J. Black, “Smpl: A skinned multi-person linear model,” ACM Transactions on Graphics (TOG), vol. 34, no. 6, 2015.
- P. Puchert and T. Ropinski, “Human pose estimation from sparse inertial measurements through recurrent graph convolution,” in Computing Research Repository, abs/2107.11214, 2021.
- L. Steffan, L. Kaul, and T. Asfour, “Online stability estimation based on inertial sensor data for human and humanoid fall prevention,” in IEEE-RAS International Conference on Humanoid Robots (Humanoids), 2017.
- Ö. Terlemez, S. Ulbrich, C. Mandery, M. Do, N. Vahrenkamp, and T. Asfour, “Master motor map (mmm)—framework and toolkit for capturing, representing, and reproducing human motion on humanoid robots,” in IEEE-RAS International Conference on Humanoid Robots (Humanoids), 2014.
- C. Mandery, Ö. Terlemez, M. Do, N. Vahrenkamp, and T. Asfour, “The kit whole-body human motion database,” in IEEE International Conference on Advanced Robotics (ICAR), 2015.
- C. Mandery, Ö. Terlemez, M. Do, N. Vahrenkamp, and T. Asfour, “Unifying representations and large-scale whole-body motion databases for studying human motion,” IEEE Transactions on Robotics, vol. 32, no. 4, 2016.
- I. Patzer and T. Asfour, “Minimal sensor setup in lower limb exoskeletons for motion classification based on multi-modal sensor data,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.