Convergence Rate Maximization for Split Learning-based Control of EMG Prosthetic Devices (2401.03233v3)
Abstract: Split Learning (SL) is a promising Distributed Learning approach in electromyography (EMG) based prosthetic control, due to its applicability within resource-constrained environments. Other learning approaches, such as Deep Learning and Federated Learning (FL), provide suboptimal solutions, since prosthetic devices are extremely limited in terms of processing power and battery life. The viability of implementing SL in such scenarios is caused by its inherent model partitioning, with clients executing the smaller model segment. However, selecting an inadequate cut layer hinders the training process in SL systems. This paper presents an algorithm for optimal cut layer selection in terms of maximizing the convergence rate of the model. The performance evaluation demonstrates that the proposed algorithm substantially accelerates the convergence in an EMG pattern recognition task for improving prosthetic device control.
- C. Thapa, M. A. Chamikara and S. A. Camtepe, “Advancements of Federated Learning Towards Privacy Preservation: From Federated Learning to Split Learning,” Federated Learning Systems: Towards Next-generation AI, Springer Nature Switzerland AG, 2021, pp. 79-109.
- O. Gupta and R. Raskar, “Distributed learning of deep neural network over multiple agents,” Journal of Network and Computer Applications, vol. 116, pp. 1-8, 2018.
- N.S. Khan, M.S. Ghani, “A Survey of Deep Learning Based Models for Human Activity Recognition,” Wireless Personal Communications, vol. 120, pp. 1593–1635, 2021.
- A. Phinyomark and E. Scheme, “EMG Pattern Recognition in the Era of Big Data and Deep Learning,” Big Data and Cognitive Computing 2,no. 3: 21, 2018. https://doi.org/10.3390/bdcc2030021
- T. Triwiyanto, I. P. A. Pawana and M. H. Purnomo, “An Improved Performance of Deep Learning Based on Convolution Neural Network to Classify the Hand Motion by Evaluating Hyper Parameter,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 28, no. 7, pp. 1678-1688, July 2020.
- E. Sansano, R. Montoliu, Ó. B. Fernández, “A study of deep neural networks for human activity recognition,” Computational Intelligence, 36 (2020), 1113–1139. https://doi.org/10.1111/coin.12318
- E. Samikwa, A. D. Maio and T. Braun, “ARES: Adaptive Resource-Aware Split Learning for Internet of Things,” Computer Networks, vol. 218, 9 December 2022.
- S. Wang, X. Zhang, H. Uchiyama and H. Matsuda, “HiveMind: Towards Cellular Native Machine Learning Model Splitting,” IEEE Journal on Selected Areas in Communications, vol. 40, no. 2, pp. 626-640, Feb. 2022.
- M. Kim, A. DeRieux, and W. Saad, “A Bargaining Game for Personalized, Energy Efficient Split Learning over Wireless Networks,” Dec. 2022.
- A. Singh, P. Vepakomma, O. Gupta, Ramesh Raskar, “Detailed comparison of communication efficiency of split learning and federated learning,” 2019. arXiv:1909.09145.
- R. N. Khushaba, M. Takruri, S. Kodagoda, and G. Dissanayake, “Toward Improved Control of Prosthetic Fingers Using Surface Electromyogram (EMG) Signals,” Expert Systems with Applications, vol 39, no. 12, pp. 10731–10738, 2012.
- Matea Marinova (1 paper)
- Daniel Denkovski (4 papers)
- Hristijan Gjoreski (2 papers)
- Zoran Hadzi-Velkov (26 papers)
- Valentin Rakovic (3 papers)