Adversary-Guided Motion Retargeting for Skeleton Anonymization (2405.05428v1)
Abstract: Skeleton-based motion visualization is a rising field in computer vision, especially in the case of virtual reality (VR). With further advancements in human-pose estimation and skeleton extracting sensors, more and more applications that utilize skeleton data have come about. These skeletons may appear to be anonymous but they contain embedded personally identifiable information (PII). In this paper we present a new anonymization technique that is based on motion retargeting, utilizing adversary classifiers to further remove PII embedded in the skeleton. Motion retargeting is effective in anonymization as it transfers the movement of the user onto the a dummy skeleton. In doing so, any PII linked to the skeleton will be based on the dummy skeleton instead of the user we are protecting. We propose a Privacy-centric Deep Motion Retargeting model (PMR) which aims to further clear the retargeted skeleton of PII through adversarial learning. In our experiments, PMR achieves motion retargeting utility performance on par with state of the art models while also reducing the performance of privacy attacks.
- Learning character-agnostic motion for motion retargeting in 2d. ACM Trans. Graph., 38(4):75:1–75:14, 2019.
- Skeleton-aware networks for deep motion retargeting. ACM Trans. Graph., 39(4):62, 2020.
- Linkage attack on skeleton-based motion visualization. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, CIKM 2023, Birmingham, United Kingdom, October 21-25, 2023, pages 3758–3762. ACM, 2023.
- Vr-surv: A vr-based privacy preserving surveillance system. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems, CHI EA ’22, New York, NY, USA, 2022. Association for Computing Machinery.
- Keep it simple and sparse: real-time action recognition. J. Mach. Learn. Res., 14(1):2617–2640, 2013.
- A kinect based intelligent e-rehabilitation system in physical therapy. In Ronald Cornet, Lacramioara Stoicu-Tivadar, Alexander Hörbst, Carlos Luis Parra Calderón, Stig Kjær Andersen, and Mira Hercigonja-Szekeres, editors, Digital Healthcare Empowering Europeans - Proceedings of MIE2015, Madrid Spain, 27-29 May, 2015, volume 210 of Studies in Health Technology and Informatics, pages 489–493. IOS Press, 2015.
- Generative adversarial nets. In Zoubin Ghahramani, Max Welling, Corinna Cortes, Neil D. Lawrence, and Kilian Q. Weinberger, editors, Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, December 8-13 2014, Montreal, Quebec, Canada, pages 2672–2680, 2014.
- Digital body, identity and privacy in social virtual reality: A systematic review. Frontiers in Virtual Reality, 3, 2022.
- Anonymization for skeleton action recognition. AAAI Press, 2023.
- Biomove: Biometric user identification from human kinesiological movements for virtual reality systems. Sensors, 20(10):2944, 2020.
- Learning skeleton representations for human action recognition. Pattern Recognit. Lett., 118:23–31, 2019.
- NTU RGB+D: A large scale dataset for 3d human activity analysis. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27-30, 2016, pages 1010–1019. IEEE Computer Society, 2016.
- Skeleton-based emotion recognition based on two-stream self-attention enhanced spatial-temporal graph convolutional network. Sensors, 21(1), 2021.
- A closer look at spatiotemporal convolutions for action recognition. In 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018, pages 6450–6459. Computer Vision Foundation / IEEE Computer Society, 2018.
- Neural kinematic networks for unsupervised motion retargetting. In 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018, pages 8639–8648. Computer Vision Foundation / IEEE Computer Society, 2018.
- Semantics-guided neural networks for efficient skeleton-based human action recognition. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, pages 1109–1118. Computer Vision Foundation / IEEE, 2020.