sEMG-based Fine-grained Gesture Recognition via Improved LightGBM Model (2404.11861v1)
Abstract: Surface electromyogram (sEMG), as a bioelectrical signal reflecting the activity of human muscles, has a wide range of applications in the control of prosthetics, human-computer interaction and so on. However, the existing recognition methods are all discrete actions, that is, every time an action is executed, it is necessary to restore the resting state before the next action, and it is unable to effectively recognize the gestures of continuous actions. To solve this problem, this paper proposes an improved fine gesture recognition model based on LightGBM algorithm. A sliding window sample segmentation scheme is adopted to replace active segment detection, and a series of innovative schemes such as improved loss function, Optuna hyperparameter search and Bagging integration are adopted to optimize LightGBM model and realize gesture recognition of continuous active segment signals. In order to verify the effectiveness of the proposed algorithm, we used the NinaproDB7 dataset to design the normal data recognition experiment and the disabled data transfer experiment. The results showed that the recognition rate of the proposed model was 89.72% higher than that of the optimal model Bi-ConvGRU for 18 gesture recognition tasks in the open data set, it reached 90.28%. Compared with the scheme directly trained on small sample data, the recognition rate of transfer learning was significantly improved from 60.35% to 78.54%, effectively solving the problem of insufficient data, and proving the applicability and advantages of transfer learning in fine gesture recognition tasks for disabled people.
- M. Z. ur Rehman, S. O. Gilani, A. Waris, I. K. Niazi, and E. N. Kamavuako, “A novel approach for classification of hand movements using surface emg signals,” in 2017 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), pp. 265–269, IEEE, 2017.
- A. H. Al-Timemy, G. Bugmann, J. Escudero, and N. Outram, “Classification of finger movements for the dexterous hand prosthesis control with surface electromyography,” IEEE journal of biomedical and health informatics, vol. 17, no. 3, pp. 608–618, 2013.
- Y. Narayan, “Semg signal classification using knn classifier with fd and tfd features,” Materials Today: Proceedings, vol. 37, pp. 3219–3225, 2021.
- N. Gozzi, L. Malandri, F. Mercorio, and A. Pedrocchi, “Xai for myo-controlled prosthesis: Explaining emg data for hand gesture classification,” Knowledge-Based Systems, vol. 240, p. 108053, 2022.
- F. Duan, X. Ren, and Y. Yang, “A gesture recognition system based on time domain features and linear discriminant analysis,” IEEE Transactions on Cognitive and Developmental Systems, vol. 13, no. 1, pp. 200–208, 2018.
- G. R. Naik, A. Acharyya, and H. T. Nguyen, “Classification of finger extension and flexion of emg and cyberglove data with modified ica weight matrix,” in 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3829–3832, IEEE, 2014.
- M. E. Benalcázar, C. Motoche, J. A. Zea, A. G. Jaramillo, C. E. Anchundia, P. Zambrano, M. Segura, F. B. Palacios, and M. Pérez, “Real-time hand gesture recognition using the myo armband and muscle activity detection,” in 2017 IEEE Second Ecuador Technical Chapters Meeting (ETCM), pp. 1–6, IEEE, 2017.
- X. Chen and Z. J. Wang, “Pattern recognition of number gestures based on a wireless surface emg system,” Biomedical Signal Processing and Control, vol. 8, no. 2, pp. 184–192, 2013.
- I. Karacan, B. T. Arslan, A. Karaoglu, T. Aydin, S. Gray, P. Ungan, and K. S. Türker, “Estimating and minimizing movement artifacts in surface electromyogram,” Journal of Electromyography and Kinesiology, vol. 70, p. 102778, 2023.
- J. Shao, Y. Niu, C. Xue, Q. Wu, X. Zhou, Y. Xie, and X. Zhao, “Single-channel semg using wavelet deep belief networks for upper limb motion recognition,” International Journal of Industrial Ergonomics, vol. 76, p. 102905, 2020.
- Z. Chen, J. Yang, and H. Xie, “Surface-electromyography-based gesture recognition using a multistream fusion strategy,” IEEE Access, vol. 9, pp. 50583–50592, 2021.
- D. K. Luu, A. T. Nguyen, M. Jiang, J. Xu, J. Cheng, and Z. Yang, “Deep learning-based approaches for decoding motor intent from peripheral nerve signals,” Frontiers in Neuroscience, vol. 15, p. 667907, 2021.
- Z. Ding, C. Yang, Z. Tian, C. Yi, Y. Fu, and F. Jiang, “semg-based gesture recognition with convolution neural networks,” Sustainability, vol. 10, no. 6, p. 1865, 2018.
- M. Atzori and H. Müller, “The ninapro database: a resource for semg naturally controlled robotic hand prosthetics,” in 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 7151–7154, IEEE, 2015.
- D. Xiong, D. Zhang, X. Zhao, and Y. Zhao, “Deep learning for emg-based human-machine interaction: A review,” IEEE/CAA Journal of Automatica Sinica, vol. 8, no. 3, pp. 512–533, 2021.
- Z. Zhang, C. He, and K. Yang, “A novel surface electromyographic signal-based hand gesture prediction using a recurrent neural network,” Sensors, vol. 20, no. 14, p. 3994, 2020.
- A. Graves and A. Graves, “Long short-term memory,” Supervised sequence labelling with recurrent neural networks, pp. 37–45, 2012.
- A. Samadani, “Gated recurrent neural networks for emg-based hand gesture classification. a comparative study,” in 2018 40th annual international conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 1–4, IEEE, 2018.
- J. Yang, J. Pan, and J. Li, “semg-based continuous hand gesture recognition using gmm-hmm and threshold model,” in 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 1509–1514, IEEE, 2017.
- U. Côté-Allard, C. L. Fall, A. Campeau-Lecours, C. Gosselin, F. Laviolette, and B. Gosselin, “Transfer learning for semg hand gestures recognition using convolutional neural networks,” in 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1663–1668, IEEE, 2017.
- L. Chen, J. Fu, Y. Wu, H. Li, and B. Zheng, “Hand gesture recognition using compact cnn via surface electromyography signals,” Sensors, vol. 20, no. 3, p. 672, 2020.
- S. Tam, M. Boukadoum, A. Campeau-Lecours, and B. Gosselin, “Intuitive real-time control strategy for high-density myoelectric hand prosthesis using deep and transfer learning,” Scientific Reports, vol. 11, no. 1, p. 11275, 2021.
- M. Simão, P. Neto, and O. Gibaru, “Emg-based online classification of gestures with recurrent neural networks,” Pattern Recognition Letters, vol. 128, pp. 45–51, 2019.
- J. Xue, Z. Sun, F. Duan, C. F. Caiafa, and J. Solé-Casals, “Underwater semg-based recognition of hand gestures using tensor decomposition,” Pattern Recognition Letters, vol. 165, pp. 39–46, 2023.
- C. Wang, W. Guo, H. Zhang, L. Guo, C. Huang, and C. Lin, “semg-based continuous estimation of grasp movements by long-short term memory network,” Biomedical Signal Processing and Control, vol. 59, p. 101774, 2020.
- P. Tsinganos, B. Cornelis, J. Cornelis, B. Jansen, and A. Skodras, “Improved gesture recognition based on semg signals and tcn,” in ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1169–1173, IEEE, 2019.
- J. L. Betthauser, J. T. Krall, S. G. Bannowsky, G. Lévay, R. R. Kaliki, M. S. Fifer, and N. V. Thakor, “Stable responsive emg sequence prediction and adaptive reinforcement with temporal convolutional networks,” IEEE Transactions on Biomedical Engineering, vol. 67, no. 6, pp. 1707–1717, 2019.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.