A Large-Scale Re-identification Analysis in Sporting Scenarios: the Betrayal of Reaching a Critical Point (2401.00080v1)
Abstract: Re-identifying participants in ultra-distance running competitions can be daunting due to the extensive distances and constantly changing terrain. To overcome these challenges, computer vision techniques have been developed to analyze runners' faces, numbers on their bibs, and clothing. However, our study presents a novel gait-based approach for runners' re-identification (re-ID) by leveraging various pre-trained human action recognition (HAR) models and loss functions. Our results show that this approach provides promising results for re-identifying runners in ultra-distance competitions. Furthermore, we investigate the significance of distinct human body movements when athletes are approaching their endurance limits and their potential impact on re-ID accuracy. Our study examines how the recognition of a runner's gait is affected by a competition's critical point (CP), defined as a moment of severe fatigue and the point where the finish line comes into view, just a few kilometers away from this location. We aim to determine how this CP can improve the accuracy of athlete re-ID. Our experimental results demonstrate that gait recognition can be significantly enhanced (up to a 9% increase in mAP) as athletes approach this point. This highlights the potential of utilizing gait recognition in real-world scenarios, such as ultra-distance competitions or long-duration surveillance tasks.
- Emotion recognition from body movement. IEEE Access, 8:11761–11781, 2020.
- Understanding the influence of perceived fatigue on coordination during endurance running. Sports Biomechanics, 19:618 – 632, 2018.
- Racing bib number recognition. In British Machine Vision Conference, pages 1–10, Surrey, UK, 2012. British Machine Vision Association.
- Filling the gaps: Predicting missing joints of human poses using denoising autoencoders. In ECCV Workshops, 2018.
- J. Carreira and A. Zisserman. Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 4724–4733, 2017.
- Beyond triplet loss: a deep quadruplet network for person re-identification, 2017.
- The arm-swing is discriminative in video gait recognition for athlete re-identification. In 2021 IEEE International Conference on Image Processing (ICIP), pages 2309–2313, 2021.
- C. Chokchai. Low cost and high performance uhf rfid system using arduino based on iot applications for marathon competition. In 2018 21st International Symposium on Wireless Personal Multimedia Communications (WPMC), pages 15–20, 2018.
- SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 3490–3501, 2022.
- Taintdroid: An information-flow tracking system for realtime privacy monitoring on smartphones. ACM Trans. Comput. Syst., 32:5:1–5:29, 2010.
- Gaitpart: Temporal part-based model for gait recognition. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 14213–14221, 2020.
- C. Feichtenhofer. X3d: Expanding architectures for efficient video recognition. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 200–210, 2020.
- Slowfast networks for video recognition. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pages 6201–6210, 2018.
- A large-scale study on unsupervised spatiotemporal representation learning. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 3298–3308, 2021.
- Towards cumulative race time regression in sports: I3D ConvNet transfer learning in ultra-distance running events. 2022 26th International Conference on Pattern Recognition (ICPR), pages 805–811, 2022.
- An attention recurrent model for human cooperation detection. Computer Vision and Image Understanding, 197-198:102991, 2020.
- Image quality assessment for fake biometric detection: Application to iris, fingerprint, and face recognition. IEEE Transactions on Image Processing, 23:710–724, 2014.
- How to catch marathon cheaters: New approximation algorithms for tracking paths, 2021.
- TGCRBNW: A Dataset for Runner Bib Number Detection (and Recognition) in the Wild. In 2020 25th International Conference on Pattern Recognition (ICPR), pages 9445–9451, 2021.
- Multi-view Multi-modal Gait Based Human Identity Recognition from Surveillance Videos. In IAPR TC3 Workshop on Multimodal Pattern Recognition of Social Signals, 2012.
- Sports motion recognition based on foot trajectory state sequence mapping. In 2019 International Joint Conference on Neural Networks (IJCNN), pages 1–8, 2019.
- An introduction to biometric recognition. IEEE Transactions on Circuits and Systems for Video Technology, 14(1):4–20, 2004.
- H. Jiang and E. G. Learned-Miller. Face detection with the faster r-cnn. 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), pages 650–657, 2016.
- The Kinetics Human Action Video Dataset. CoRR, 2017.
- A case study of automated face recognition: The boston marathon bombings suspects. Computer, 46(11):91–94, 2013.
- A survey of vision-based human action evaluation methods. Sensors, 19(19), 2019.
- A survey on player tracking in soccer videos. Comput. Vis. Image Underst., 159:19–46, 2017.
- Gait-based Person Re-identification. ACM Computing Surveys (CSUR), 52:1 – 34, 2019.
- TGC20ReId: A dataset for sport event re-identification in the wild. Pattern Recognition Letters, 138:355–361, 2020.
- Fatigue induced changes in muscle strength and gait following two different intensity, energy expenditure matched runs. Frontiers in Bioengineering and Biotechnology, 8, 2020.
- FaceNet: A unified embedding for face recognition and clustering. In 2015 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pages 815–823, 2015.
- K. Simonyan and A. Zisserman. Two-stream convolutional networks for action recognition in videos. ArXiv, abs/1406.2199, 2014.
- Deep high-resolution representation learning for human pose estimation. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5686–5696, 2019.
- Gaitgraph: Graph convolutional network for skeleton-based gait recognition. In 2021 IEEE International Conference on Image Processing (ICIP), pages 2314–2318, 2021.
- Tracking Systems in Team Sports: A Narrative Review of Applications of the Data and Sport Specific Analysis. Sports Medicine - Open, 8, 2022.
- J. Tozer and N. Anderson. How can someone who cheated cross a finish line and collect a medal? https://www.dailymail.co.uk/news/article-11987195/Leading-British-ultra-marathon-runner-47-disqualified-race-using-CAR.html. Accessed: 2023-05-05.
- Silhouette analysis-based gait recognition for human identification. IEEE Trans. Pattern Anal. Mach. Intell., 25:1505–1518, 2003.
- Non-local neural networks. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7794–7803, 2017.
- K. Wnuk and S. Soatto. Analyzing diving: A dataset for judging action quality. In R. Koch and F. Huang, editors, Computer Vision - ACCV 2010 Workshops - ACCV, volume 6468 of Lecture Notes in Computer Science, pages 266–276. Springer, 2010.
- ByteTrack: Multi-Object Tracking by Associating Every Detection Box. In European Conference on Computer Vision, 2021.
- David Freire-Obregón (9 papers)
- Javier Lorenzo-Navarro (8 papers)
- Oliverio J. Santana (6 papers)
- Daniel Hernández-Sosa (7 papers)
- Modesto Castrillón-Santana (9 papers)