Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Estimating continuous data of wrist joint angles using ultrasound images (2401.02152v1)

Published 4 Jan 2024 in cs.HC, cs.RO, and eess.SP

Abstract: Ultrasound imaging has recently been introduced as a sensing interface for joint motion estimation. The use of ultrasound images as an estimation method is expected to improve the control performance of assistive devices and human--machine interfaces. This study aimed to estimate continuous wrist joint angles using ultrasound images. Specifically, in an experiment, joint angle information was obtained during extension--flexion movements, and ultrasound images of the associated muscles were acquired. Using the features obtained from ultrasound images, a multivariate linear regression model was used to estimate the joint angles. The coordinates of the feature points obtained using optical flow from the ultrasound images were used as explanatory variables of the multivariate linear regression model. The model was trained and tested for each trial by each participant to verify the estimation accuracy. The results show that the mean and standard deviation of the estimation accuracy for all trials were root mean square error (RMSE)=1.82 $\pm$ 0.54 deg and coefficient of determination (R2)=0.985 $\pm$ 0.009. Our method achieves a highly accurate estimation of joint angles compared with previous studies using other signals, such as surface electromyography, while the multivariate linear regression model is simple and both computational and model training costs are low.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (51)
  1. Bionic prosthetic hands: A review of present technology and future aspirations. The surgeon, 9(6):336–340, 2011.
  2. Control strategies for active lower extremity prosthetics and orthotics: a review. Journal of neuroengineering and rehabilitation, 12(1):1–30, 2015.
  3. A review on lower limb rehabilitation exoskeleton robots. Chinese Journal of Mechanical Engineering, 32(1):1–11, 2019.
  4. Lower limb rehabilitation exoskeleton robot: A review. Advances in Mechanical Engineering, 13(4):16878140211011862, 2021.
  5. Considerations for industrial use: a systematic review of the impact of active and passive upper limb exoskeletons on physical exposures. IISE Transactions on Occupational Ergonomics and Human Factors, 7(3-4):322–347, 2019.
  6. Exoskeletons in upper limb rehabilitation: A review to find key challenges to improve functionality. Control Theory in Biomedical Engineering, pages 235–265, 2020.
  7. Soft robotic suits: State of the art, core technologies, and open challenges. IEEE Transactions on Robotics, 38(3):1343–1362, 2021.
  8. Upper limb soft robotic wearable devices: a systematic review. Journal of NeuroEngineering and Rehabilitation, 19(1):1–17, 2022.
  9. A review of soft wearable robots that provide active assistance: Trends, common actuation methods, fabrication, and applications. Wearable Technologies, 1:e3, 2020.
  10. Systematic review of back-support exoskeletons and soft robotic suits. Frontiers in bioengineering and biotechnology, 9:765257, 2021.
  11. Estimating wrist joint angle with limited skin deformation information. Journal of Biomechanical Science and Engineering, 13(2):17–00596, 2018.
  12. Design and embedded control of a soft elbow exosuit. In 2018 IEEE international conference on soft robotics (RoboSoft), pages 565–571. IEEE, 2018.
  13. Hierarchical cascade controller for assistance modulation in a soft wearable arm exoskeleton. IEEE robotics and automation letters, 2(3):1786–1793, 2017.
  14. Adaptive model-based myoelectric control for a soft wearable arm exosuit: A new generation of wearable robot control. IEEE Robotics & Automation Magazine, 27(1):43–53, 2020.
  15. An emg-driven musculoskeletal model for estimating continuous wrist motion. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 28(12):3113–3120, 2020.
  16. Joint angle estimation using accelerometer arrays and model-based filtering. IEEE Sensors Journal, 22(20):19786–19796, 2022.
  17. Measuring flexion in knee arthroplasty patients. The Journal of arthroplasty, 19(3):369–372, 2004.
  18. Monitoring of hip and knee joint angles using a single inertial measurement unit during lower limb rehabilitation. IEEE Sensors journal, 16(6):1557–1564, 2015.
  19. A dual-modal approach using electromyography and sonomyography improves prediction of dynamic ankle movement: A case study. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 29:1944–1954, 2021.
  20. Human joint motion estimation for electromyography (emg)-based dynamic motion control. In 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pages 21–24. IEEE, 2013.
  21. Hierarchical projection regression for online estimation of elbow joint angle using emg signals. Neural Computing and Applications, 23:1129–1138, 2013.
  22. Wrist angle estimation based on musculoskeletal systems with emg. In Proceedings of the 6th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems, volume 1, pages 269–276, 2011.
  23. Robotic leg control with emg decoding in an amputee with nerve transfers. New England Journal of Medicine, 369(13):1237–1242, 2013.
  24. Ultrasound reveals negligible cocontraction during isometric plantar flexion and dorsiflexion despite the presence of antagonist electromyographic activity. Journal of Applied Physiology, 118(10):1193–1199, 2015.
  25. Performances of one-dimensional sonomyography and surface electromyography in tracking guided patterns of wrist extension. Ultrasound in medicine & biology, 35(6):894–902, 2009.
  26. Towards wearable a-mode ultrasound sensing for real-time finger motion recognition. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 26(6):1199–1208, 2018.
  27. Recognition of finger flexion motion from ultrasound image: A feasibility study. Ultrasound in medicine & biology, 38(10):1695–1704, 2012.
  28. Novel method for predicting dexterous individual finger movements by imaging muscle activity using a wearable ultrasonic system. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 22(1):69–76, 2013.
  29. Ultrasound-based sensing models for finger motion classification. IEEE journal of biomedical and health informatics, 22(5):1395–1405, 2017.
  30. Echoflex: Hand gesture recognition using ultrasound imaging. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pages 1923–1934, 2017.
  31. Automated detection of soleus concentric contraction in variable gait conditions for improved exosuit control. In 2020 IEEE International Conference on Robotics and Automation (ICRA), pages 4855–4862. IEEE, 2020.
  32. Individualization of exosuit assistance based on measured muscle dynamics during versatile walking. Science robotics, 6(60):eabj1362, 2021.
  33. Stephen Butterworth et al. On the theory of filter amplifiers. Wireless Engineer, 7(6):536–541, 1930.
  34. Jianbo Shi et al. Good features to track. In 1994 Proceedings of IEEE conference on computer vision and pattern recognition, pages 593–600. IEEE, 1994.
  35. An iterative image registration technique with an application to stereo vision. In IJCAI’81: 7th international joint conference on Artificial intelligence, volume 2, pages 674–679, 1981.
  36. Stretchable ultrasonic transducer arrays for three-dimensional imaging on complex surfaces. Science advances, 4(3):eaar3979, 2018.
  37. Flexible body-conformal ultrasound patches for image-guided neuromodulation. IEEE Transactions on Biomedical Circuits and Systems, 14(2):305–318, 2019.
  38. Flexible ultrasound transceiver array for non-invasive surface-conformable imaging enabled by geometric phase correction. Scientific Reports, 12(1):16184, 2022.
  39. Bioadhesive ultrasound for long-term continuous imaging of diverse organs. Science, 377(6605):517–523, 2022.
  40. Stretchable ultrasonic arrays for the three-dimensional mapping of the modulus of deep tissue. Nature Biomedical Engineering, pages 1–14, 2023.
  41. Textile-based conformable and breathable ultrasound imaging probe. arXiv preprint arXiv:2311.03787, 2023.
  42. Recent advances in physical reservoir computing: A review. Neural Networks, 115:100–123, 2019.
  43. Kohei Nakajima. Physical reservoir computing—an introductory perspective. Japanese Journal of Applied Physics, 59(6):060501, 2020.
  44. Computation with mechanically coupled springs for compliant robots. In 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 4168–4173. IEEE, 2011.
  45. Embodiment enables the spinal engine in quadruped robot locomotion. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 2449–2456. IEEE, 2012.
  46. Information processing via physical soft body. Scientific reports, 5(1):10487, 2015.
  47. Exploiting short-term memory in soft body dynamics as a computational resource. Journal of The Royal Society Interface, 11(100):20140437, 2014.
  48. A soft body as a reservoir: case studies in a dynamic model of octopus-inspired soft robotic arm. Frontiers in computational neuroscience, 7:91, 2013.
  49. Exploiting the dynamics of soft materials for machine learning. Soft robotics, 5(3):339–347, 2018.
  50. Wearable tactile sensor suit for natural body dynamics extraction: case study on posture prediction based on physical reservoir computing. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 9504–9511. IEEE, 2021.
  51. Yo Kobayashi. Information processing via human soft tissue. arXiv preprint arXiv:2305.14366, 2023.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now