Enhancing Joint Motion Prediction for Individuals with Limb Loss Through Model Reprogramming (2403.06569v2)
Abstract: Mobility impairment caused by limb loss is a significant challenge faced by millions of individuals worldwide. The development of advanced assistive technologies, such as prosthetic devices, has the potential to greatly improve the quality of life for amputee patients. A critical component in the design of such technologies is the accurate prediction of reference joint motion for the missing limb. However, this task is hindered by the scarcity of joint motion data available for amputee patients, in contrast to the substantial quantity of data from able-bodied subjects. To overcome this, we leverage deep learning's reprogramming property to repurpose well-trained models for a new goal without altering the model parameters. With only data-level manipulation, we adapt models originally designed for able-bodied people to forecast joint motion in amputees. The findings in this study have significant implications for advancing assistive tech and amputee mobility.
- An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv preprint arXiv:1803.01271, 2018.
- Opensim: open-source software to create and analyze dynamic simulations of movement. IEEE transactions on biomedical engineering, 54(11):1940–1950, 2007.
- A random forest approach for continuous prediction of joint angles and moments during walking: An implication for controlling active knee-ankle prostheses/orthoses. In 2019 IEEE International conference on Cyborg and bionic systems (CBS), pp. 66–71. IEEE, 2019.
- Continuous prediction of joint angular positions and moments: A potential control strategy for active knee-ankle prostheses. IEEE Transactions on Medical Robotics and Bionics, 2(3):347–355, 2020a.
- Feasibility of training a random forest model with incomplete user-specific data for devising a control strategy for active biomimetic ankle. Frontiers in Bioengineering and Biotechnology, 8:855, 2020b.
- Adversarial reprogramming of neural networks. arXiv preprint arXiv:1806.11146, 2018.
- A review of current state-of-the-art control methods for lower-limb powered prostheses. Annual Reviews in Control, 2023.
- Warp: Word-level adversarial reprogramming. arXiv preprint arXiv:2101.00121, 2021.
- Benchmark datasets for bilateral lower-limb neuromechanical signals from wearable sensors during unassisted locomotion in able-bodied individuals. Frontiers in Robotics and AI, 5:14, 2018.
- Voice2series: Reprogramming acoustic models for time series classification. arXiv e-prints, pp. arXiv–2106, 2021.
- Transfer learning without knowing: Reprogramming black-box machine learning models with scarce data and limited resources. In International Conference on Machine Learning, pp. 9614–9624. PMLR, 2020.
- Watermarking for out-of-distribution detection. Advances in Neural Information Processing Systems, 35:15545–15557, 2022.
- Active lower limb prosthetics: a systematic review of design issues and solutions. Biomedical engineering online, 15(3):5–19, 2016.