Counterfactual Explanation-Based Badminton Motion Guidance Generation Using Wearable Sensors (2405.11802v1)
Abstract: This study proposes a framework for enhancing the stroke quality of badminton players by generating personalized motion guides, utilizing a multimodal wearable dataset. These guides are based on counterfactual algorithms and aim to reduce the performance gap between novice and expert players. Our approach provides joint-level guidance through visualizable data to assist players in improving their movements without requiring expert knowledge. The method was evaluated against a traditional algorithm using metrics to assess validity, proximity, and plausibility, including arithmetic measures and motion-specific evaluation metrics. Our evaluation demonstrates that the proposed framework can generate motions that maintain the essence of original movements while enhancing stroke quality, providing closer guidance than direct expert motion replication. The results highlight the potential of our approach for creating personalized sports motion guides by generating counterfactual motion guidance for arbitrary input motion samples of badminton strokes.
- C.-C. Liao, D.-H. Hwang, and H. Koike, “Ai golf: Golf swing analysis tool for self-training,” IEEE Access, vol. 10, pp. 106 286–106 295, 2022.
- S. Qiu, H. Zhao, N. Jiang, Z. Wang, L. Liu, Y. An, H. Zhao, X. Miao, R. Liu, and G. Fortino, “Multi-sensor information fusion based on machine learning for real applications in human activity recognition: State-of-the-art and research challenges,” Information Fusion, vol. 80, pp. 241–265, 2022.
- M. Seong, J. Oh, and S. Kim, “Team badminseok at ijcai coachai badminton challenge 2023: Multi-layer multi-input transformer network (mulminet) with weighted loss,” arXiv preprint arXiv:2307.08262, 2023.
- I. Ghosh, S. R. Ramamurthy, A. Chakma, and N. Roy, “Decoach: Deep learning-based coaching for badminton player assessment,” Pervasive and Mobile Computing, vol. 83, p. 101608, 2022.
- S. Wachter, B. Mittelstadt, and C. Russell, “Counterfactual explanations without opening the black box: Automated decisions and the gdpr,” Harv. JL & Tech., vol. 31, p. 841, 2017.
- M. Seong, G. Kim, D. Yeo, Y. Kang, H. Yang, J. DelPreto, W. Matusik, D. Rus, and S. Kim, “Multisensebadminton: Wearable sensor–based biomechanical dataset for evaluation of badminton performance,” Scientific Data, vol. 11, no. 1, p. 343, 2024.
- E. Delaney, D. Greene, and M. T. Keane, “Instance-based counterfactual explanations for time series classification,” in International conference on case-based reasoning. Springer, 2021, pp. 32–47.
- Z. Wang, I. Samsten, R. Mochaourab, and P. Papapetrou, “Learning time series counterfactuals via latent space representations,” in Discovery Science: 24th International Conference, DS 2021, Halifax, NS, Canada, October 11–13, 2021, Proceedings 24. Springer, 2021, pp. 369–384.
- Z. Wang, I. Samsten, and P. Papapetrou, “Counterfactual explanations for survival prediction of cardiovascular icu patients,” in Artificial Intelligence in Medicine: 19th International Conference on Artificial Intelligence in Medicine, AIME 2021, Virtual Event, June 15–18, 2021, Proceedings. Springer, 2021, pp. 338–348.
- H. Y. Au, J. Chen, J. Jiang, and Y. Guo, “Choreograph: Music-conditioned automatic dance choreography over a style and tempo consistent dynamic graph,” in Proceedings of the 30th ACM International Conference on Multimedia, 2022, pp. 3917–3925.
- S. Hwang, J. Oh, S. Kang, M. Seong, A. I. A. M. Elsharkawy, and S. Kim, “Ergopulse: Electrifying your lower body with biomechanical simulation-based electrical muscle stimulation haptic system in virtual reality,” in Proceedings of the CHI Conference on Human Factors in Computing Systems, 2024, pp. 1–21.
- S. Hwang, Y. Kim, Y. Seo, and S. Kim, “Enhancing seamless walking in virtual reality: Application of bone-conduction vibration in redirected walking,” in 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 2023, pp. 1181–1190.
- S. Hwang, J. Lee, Y. Kim, Y. Seo, and S. Kim, “Electrical, vibrational, and cooling stimuli-based redirected walking: Comparison of various vestibular stimulation-based redirected walking systems,” in Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 2023, pp. 1–18.
- S. Hwang, J. Lee, Y. Kim, and S. Kim, “Reves: Redirection enhancement using four-pole vestibular electrode stimulation,” in CHI Conference on Human Factors in Computing Systems Extended Abstracts, 2022, pp. 1–7.
- E. Wu, T. Nozawa, F. Perteneder, and H. Koike, “Vr alpine ski training augmentation using visual cues of leading skier,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020, pp. 878–879.
- E. Wu, F. Perteneder, H. Koike, and T. Nozawa, “How to vizski: Visualizing captured skier motion in a vr ski training simulator,” in Proceedings of the 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry, 2019, pp. 1–9.