Estimation of posture and joint angle of human body using foot pressure distribution: Morphological computation with human foot (2401.12464v1)
Abstract: This paper proposes a novel contact and wearable sensing system for estimating the upper body posture and joint angles (ankle, knee, and hip) of the human body using foot pressure distribution information obtained from a sensor attached to the plantar region. In the proposed estimation method, sensors are installed only on the plantar region, which is the end of the human body and the point of contact with the environment. The posture and joint angles of other parts of the body are estimated using only this information. As a contact and wearable sensor, the proposed system differs from previous measurement systems in the sense that the sensor does not need to be placed near the target joint or body. The estimation was carried out using a multivariate linear regression model with the foot pressure distribution as the input and the joint angle or posture as the output. The results reveal that it is possible to estimate the posture and joint angles of the human body from foot pressure distribution information (R2$\fallingdotseq$0.9). The proposed estimation method was validated by morphological computation to confirm that it is enabled by foot morphology. The validation approach compared the estimation accuracy achieved when an object was interposed between the foot pressure distribution sensor and the plantar region and the morphological relationship of the plantar region to the environment varied. The results reveal that there is a significant difference in the estimation accuracy between cases with and without an intervening object, suggesting that the morphology of the plantar region contributes to the estimation. Furthermore, the proposed estimation method is considered as physical reservoir computing, wherein the human foot is used as a computational resource.
- Joint angle estimation using accelerometer arrays and model-based filtering. IEEE Sensors Journal, 22(20):19786–19796, 2022.
- R Williamson and BJ Andrews. Detecting absolute human knee angle and angular velocity using accelerometers and rate gyroscopes. Medical and Biological Engineering and Computing, 39:294–302, 2001.
- A virtual element-based postural optimization method for improved ergonomics during human-robot collaboration. IEEE Transactions on Automation Science and Engineering, 19(3):1772–1783, 2022.
- An adaptive control strategy for postural stability using a wearable robot. Robotics and Autonomous Systems, 73:16–23, 2015.
- 3d human body pose estimation in virtual reality: A survey. In 2022 13th International Conference on Information and Communication Technology Convergence (ICTC), pages 624–628, 2022.
- Gesture interaction in virtual reality. Virtual Reality & Intelligent Hardware, 1(1):84–112, 2019.
- Monitoring of hip and knee joint angles using a single inertial measurement unit during lower limb rehabilitation. IEEE Sensors journal, 16(6):1557–1564, 2015.
- Shoulder and elbow joint angle tracking with inertial sensors. IEEE Transactions on Biomedical Engineering, 59(9):2635–2641, 2012.
- Human joint angle estimation with inertial sensors and validation with a robot arm. IEEE Transactions on Biomedical Engineering, 62(7):1759–1767, 2015.
- Wearable imu-based system for real-time monitoring of lower-limb joints. IEEE sensors journal, 21(6):8267–8275, 2020.
- A robust orientation filter for wearable sensing applications. IEEE Sensors Journal, 20(23):14228–14236, 2020.
- A wearable, multimodal sensing system to monitor knee joint health. IEEE Sensors Journal, 20(18):10323–10334, 2020.
- Evaluation of the global optimisation method within the upper limb kinematics analysis. Journal of biomechanics, 35(9):1279–1283, 2002.
- Estimation of posture and position based on geometric calculation using imus. In IECON 2019-45th Annual Conference of the IEEE Industrial Electronics Society, volume 1, pages 5388–5393. IEEE, 2019.
- Motion tracking: No silver bullet, but a respectable arsenal. IEEE Computer graphics and Applications, 22(6):24–38, 2002.
- Cross-view tracking for multi-human 3d pose estimation at over 100 fps. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 3279–3288, 2020.
- In the wild human pose estimation using explicit 2d features and intermediate 3d representations. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10905–10914, 2019.
- Xnect: Real-time multi-person 3d motion capture with a single rgb camera. Acm Transactions On Graphics (TOG), 39(4):82–1, 2020.
- Deep convolutional networks for marker-less human pose estimation from multiple views. In Proceedings of the 13th European conference on visual media production (CVMP 2016), pages 1–9, 2016.
- Monocular total capture: Posing face, body, and hands in the wild. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10965–10974, 2019.
- Transpose: Real-time 3d human translation and pose estimation with six inertial sensors. ACM Transactions on Graphics (TOG), 40(4):1–13, 2021.
- Measuring flexion in knee arthroplasty patients. The Journal of arthroplasty, 19(3):369–372, 2004.
- Automatic real-time occupational posture evaluation and select corresponding ergonomic assessments. Scientific Reports, 12(1):2139, 2022.
- The role of plantar cutaneous sensation in unperturbed stance. Experimental brain research, 156:505–512, 2004.
- Particular protrusion perception arising from plantar sensory input and task guidance enhances lower limb joint dynamics during gait. Journal of Physical Therapy Science, 31(3):261–266, 2019.
- The plantar sole is a ‘dynamometric map’for human balance control. Neuroreport, 9(14):3247–3252, 1998.
- Evaluating the function of the foot core system in the elderly. JoVE (Journal of Visualized Experiments), (181):e63479, 2022.
- How the Body Shapes the Way We Think. The MIT Press, 2006.
- Recent advances in physical reservoir computing: A review. Neural Networks, 115:100–123, 2019.
- Kohei Nakajima. Physical reservoir computing—an introductory perspective. Japanese Journal of Applied Physics, 59(6):060501, 2020.
- Computation with mechanically coupled springs for compliant robots. In 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 4168–4173. IEEE, 2011.
- Embodiment enables the spinal engine in quadruped robot locomotion. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 2449–2456. IEEE, 2012.
- Information processing via physical soft body. Scientific reports, 5(1):10487, 2015.
- Exploiting short-term memory in soft body dynamics as a computational resource. Journal of The Royal Society Interface, 11(100):20140437, 2014.
- A soft body as a reservoir: case studies in a dynamic model of octopus-inspired soft robotic arm. Frontiers in computational neuroscience, 7:91, 2013.
- Exploiting the dynamics of soft materials for machine learning. Soft robotics, 5(3):339–347, 2018.
- Wearable tactile sensor suit for natural body dynamics extraction: case study on posture prediction based on physical reservoir computing. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 9504–9511. IEEE, 2021.
- Yo Kobayashi. Information processing via human soft tissue. arXiv preprint arXiv:2305.14366, 2023.
- Mario Bizzini. Sensomotorische Rehabilitation nach Beinverletzungen: mit Fallbeispielen in allen Heilungsstadien. Thieme Georg Verlag, 2000.
- Kirsten Götz-Neumann. Gehen verstehen: Ganganalyse in der Physiotherapie. Thieme, 2006.
- Tetsushi Nonaka. Locating the inexhaustible: Material, medium, and ambient information. Frontiers in psychology, 11:447, 2020.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.