Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Cross-Covariate Gait Recognition: A Benchmark (2312.14404v4)

Published 22 Dec 2023 in cs.CV

Abstract: Gait datasets are essential for gait research. However, this paper observes that present benchmarks, whether conventional constrained or emerging real-world datasets, fall short regarding covariate diversity. To bridge this gap, we undertake an arduous 20-month effort to collect a cross-covariate gait recognition (CCGR) dataset. The CCGR dataset has 970 subjects and about 1.6 million sequences; almost every subject has 33 views and 53 different covariates. Compared to existing datasets, CCGR has both population and individual-level diversity. In addition, the views and covariates are well labeled, enabling the analysis of the effects of different factors. CCGR provides multiple types of gait data, including RGB, parsing, silhouette, and pose, offering researchers a comprehensive resource for exploration. In order to delve deeper into addressing cross-covariate gait recognition, we propose parsing-based gait recognition (ParsingGait) by utilizing the newly proposed parsing data. We have conducted extensive experiments. Our main results show: 1) Cross-covariate emerges as a pivotal challenge for practical applications of gait recognition. 2) ParsingGait demonstrates remarkable potential for further advancement. 3) Alarmingly, existing SOTA methods achieve less than 43% accuracy on the CCGR, highlighting the urgency of exploring cross-covariate gait recognition. Link: https://github.com/ShinanZou/CCGR.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (46)
  1. Clothing-invariant gait identification using part-based clothing categorization and adaptive weight control. PR, 43(6): 2281–2291.
  2. Performance Evaluation of Model-based Gait on Multi-view Very Large Population Database with Pose Sequences. IEEE Trans. on Biometrics, Behavior, and Identity Science.
  3. Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields. In CVPR.
  4. GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition. In AAAI.
  5. Hybrid task cascade for instance segmentation. In CVPR.
  6. The Arm-Swing is Discriminative in Video Gait Recognition for Athlete Re-Identification. In ICIP.
  7. A Dataset and Method for Gait Recognition with Unmanned Aerial Vehicless. In ICME.
  8. Exploring Deep Models for Practical Gait Recognition. ArXiv, abs/2303.03301.
  9. OpenGait: Revisiting Gait Recognition Towards Better Practicality. In CVPR, 9707–9716.
  10. GaitPart: Temporal Part-Based Model for Gait Recognition. In CVPR.
  11. RMPE: Regional Multi-Person Pose Estimation. In ICCV.
  12. Instance-Level Human Parsing via Part Grouping Network. In ECCV, 805–822. ISBN 978-3-030-01225-0.
  13. The CMU Motion of Body (MoBo) Database. Monumenta Nipponica.
  14. The TUM Gait from Audio, Image and Depth (GAID) database: Multimodal recognition of subjects and traits. JVCIR, 25(1): 195–206.
  15. Context-Sensitive Temporal Feature Learning for Gait Recognition. In ICCV, 12909–12918.
  16. The OU-ISIR Gait Database Comprising the Large Population Dataset and Performance Evaluation of Gait Recognition. IEEE Trans. on Information Forensics and Security, 7, Issue 5: 1511–1521.
  17. Panoptic Feature Pyramid Networks. In CVPR.
  18. An In-Depth Exploration of Person Re-Identification and Gait Recognition in Cloth-Changing Conditions. In CVPR, 13824–13833.
  19. Multi-View Large Population Gait Database With Human Meshes and Its Performance Evaluation. IEEE Transactions on Biometrics, Behavior, and Identity Science, 4(2): 234–248.
  20. Look into Person: Joint Body Parsing & Pose Estimation Network and a New Benchmark. IEEE TPAMI.
  21. Gait Recognition via Effective Global-Local Feature Representation and Local Temporal Aggregation. In ICCV, 14648–14656.
  22. Toward understanding the limits of gait recognition. In Biometric Technology for Human Identification. SPIE.
  23. Gait Analysis of Gender and Age Using a Large-Scale Multi-view Gait Database. In Kimmel, R.; Klette, R.; and Sugimoto, A., eds., ACCV, 440–451. Berlin, Heidelberg: Springer Berlin Heidelberg. ISBN 978-3-642-19309-5.
  24. Gait Recognition under Speed Transition. In CVPR.
  25. ReSGait: The Real-Scene Gait Dataset. In IJCB 2021.
  26. The humanID gait challenge problem: data sets, performance, and analysis. IEEE TPAMI, 27(2): 162–177.
  27. LidarGait: Benchmarking 3D Gait Recognition With Point Clouds. In CVPR, 1054–1063.
  28. GEINet: View-invariant gait recognition using a convolutional neural network. In ICB, 1–8.
  29. On a large sequence-based human gaitdatabase. In Applications and Science in Soft Computing.
  30. CASIA-E: a large comprehensive dataset for gait recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(3): 2801–2815.
  31. Deep High-Resolution Representation Learning for Human Pose Estimation. In CVPR.
  32. Multi-view large population gait dataset and its performance evaluation for cross-view gait recognition. IPSJ Transactions on Computer Vision and Applications, 10.
  33. Efficient Night Gait Recognition Based on Template Matching. In ICPR), volume 3, 1000–1003.
  34. Towards a Deeper Understanding of Skeleton-Based Gait Recognition. In CVPRW.
  35. Gaitgraph: Graph Convolutional Network for Skeleton-Based Gait Recognition. In 2021 IEEE International Conference on Image Processing (ICIP), 2314–2318.
  36. The OU-ISIR Large Population Gait Database with real-life carried object and its performance evaluation. IPSJ Transactions on Computer Vision and Applications, 10(1): 5.
  37. Deep High-Resolution Representation Learning for Visual Recognition. IEEE TPAMI.
  38. Silhouette analysis-based gait recognition for human identification. IEEE TPAMI.
  39. Joint Multi-Person Pose Estimation and Semantic Part Segmentation. In CVPR.
  40. SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers. In Advances in Neural Information Processing Systems.
  41. The OU-ISIR Gait Database Comprising the Large Population Dataset with Age and Performance Evaluation of Age Estimation. IPSJ Trans. on Computer Vision and Applications, 9(24): 1–14.
  42. Quality-Aware Network for Human Parsing. In arXiv preprint arXiv:2103.05997.
  43. A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition. In ICPR, volume 4, 441–444.
  44. Understanding Humans in Crowded Scenes: Deep Nested Adversarial Learning and A New Benchmark for Multi-Human Parsing. In ACM MM, 792–800. ISBN 9781450356657.
  45. Gait Recognition in the Wild With Dense 3D Representations and a Benchmark. In CVPR, 20228–20237.
  46. Gait Recognition in the Wild: A Benchmark. In ICCV, 14789–14799.
Citations (5)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Github Logo Streamline Icon: https://streamlinehq.com

GitHub

  1. GitHub - ShinanZou/CCGR: Cross-Covariate Gait Recognition (29 stars)