Gait Recognition in Large-scale Free Environment via Single LiDAR (2211.12371v3)
Abstract: Human gait recognition is crucial in multimedia, enabling identification through walking patterns without direct interaction, enhancing the integration across various media forms in real-world applications like smart homes, healthcare and non-intrusive security. LiDAR's ability to capture depth makes it pivotal for robotic perception and holds promise for real-world gait recognition. In this paper, based on a single LiDAR, we present the Hierarchical Multi-representation Feature Interaction Network (HMRNet) for robust gait recognition. Prevailing LiDAR-based gait datasets primarily derive from controlled settings with predefined trajectory, remaining a gap with real-world scenarios. To facilitate LiDAR-based gait recognition research, we introduce FreeGait, a comprehensive gait dataset from large-scale, unconstrained settings, enriched with multi-modal and varied 2D/3D data. Notably, our approach achieves state-of-the-art performance on prior dataset (SUSTech1K) and on FreeGait.
- 2V-Gait: Gait Recognition using 3D LiDAR Robust to Changes in Walking Direction and Measurement Distance. In SII, 602–607. IEEE.
- 3d-mininet: Learning a 2d representation from point clouds for fast and efficient 3d lidar semantic segmentation. RAL, 5(4): 5432–5439.
- Lidar-based gait analysis and activity recognition in a 4d surveillance system. TCSVT, 28(1): 101–113.
- Multimodal feature fusion for CNN-based gait recognition: an empirical comparison. Neural Computing and Applications, 32: 14173–14193.
- Gaitset: Regarding gait as a set for cross-view gait recognition. In AAAI, volume 33, 8126–8133.
- STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenes. In CVPR, 19608–19617.
- HSC4D: Human-centered 4D Scene Capture in Large-scale Indoor-outdoor Space Using Wearable IMUs and LiDAR. CVPR, 6782–6792.
- OpenGait: Revisiting Gait Recognition Towards Better Practicality. In CVPR, 9707–9716.
- Gaitpart: Temporal part-based model for gait recognition. In CVPR, 14225–14233.
- Yolox: Exceeding yolo series in 2021. arXiv preprint arXiv:2107.08430.
- The TUM Gait from Audio, Image and Depth (GAID) database: Multimodal recognition of subjects and traits. JVCIR, 25(1): 195–206.
- Gait lateral network: Learning discriminative and compact representations for gait recognition. In ECCV, 382–398. Springer.
- Squeeze-and-excitation networks. In CVPR, 7132–7141.
- Context-sensitive temporal feature learning for gait recognition. In ICCV, 12909–12918.
- The ou-isir gait database comprising the large population dataset and performance evaluation of gait recognition. TIFS, 7(5): 1511–1521.
- Rethinking range view representation for lidar segmentation. arXiv preprint arXiv:2303.05367.
- Kumar; and etc. 2021. Gait recognition based on vision systems: A systematic survey. J. Vis. Commun. Image Represent., 75: 103052.
- An In-Depth Exploration of Person Re-Identification and Gait Recognition in Cloth-Changing Conditions. In CVPR, 13824–13833.
- Gaitedge: Beyond plain end-to-end gait recognition for better practicality. In ECCV 2022, 375–390. Springer.
- A model-based gait recognition method with body pose and human prior knowledge. PR, 98: 107069.
- Gait recognition via effective global-local feature representation and local temporal aggregation. In ICCV, 14648–14656.
- Votehmr: Occlusion-aware voting network for robust 3d human mesh recovery from partial point clouds. In Proceedings of the 29th ACM International Conference on Multimedia, 955–964.
- Rethinking network design and local geometry in point cloud: A simple residual mlp framework. arXiv preprint arXiv:2202.07123.
- Makihara, Y. 2010. Silhouette transformation based on walking speed for gait identification. In CVPR.
- UGaitNet: multimodal gait recognition with missing input modalities. IEEE Transactions on Information Forensics and Security, 16: 5452–5462.
- Boosting Few-shot 3D Point Cloud Segmentation via Query-Guided Enhancement. In Proceedings of the 31st ACM International Conference on Multimedia, 1895–1904.
- Analyzing and recognizing walking figures in XYT. CVPR, 469–474.
- Learning Rich Features for Gait Recognition by Integrating Skeletons and Silhouettes. arXiv preprint arXiv:2110.13408.
- Pointnet: Deep learning on point sets for 3d classification and segmentation. In CVPR, 652–660.
- Lidargait: Benchmarking 3d gait recognition with point clouds. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1054–1063.
- CASIA-E: a large comprehensive dataset for gait recognition. TPAMI, 45(3): 2801–2815.
- Multi-view large population gait dataset and its performance evaluation for cross-view gait recognition. IPSJ TCVA, 10(1): 1–14.
- Efficient night gait recognition based on template matching. In ICPR, volume 3, 1000–1003. IEEE.
- Gaitgraph: Graph convolutional network for skeleton-based gait recognition. In ICIP, 2314–2318. IEEE.
- Gait Recognition System: A Survey. Journal of University of Shanghai for Science and Technology.
- Attention is All you Need. ArXiv, abs/1706.03762.
- Deep high-resolution representation learning for visual recognition. TPAMI, 43(10): 3349–3364.
- Silhouette analysis-based gait recognition for human identification. TPAMI, 25(12): 1505–1518.
- Transferring CLIP’s Knowledge into Zero-Shot Point Cloud Semantic Segmentation. In Proceedings of the 31st ACM International Conference on Multimedia, 3745–3754.
- Human-centric Scene Understanding for 3D Large-scale Scenarios. arXiv preprint arXiv:2307.14392.
- A large RGB-D gait dataset and the baseline algorithm. In Biometric Recognition, 417–424. Springer.
- A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition. In ICPR, volume 4, 441–444. IEEE.
- Polarnet: An improved grid representation for online lidar point clouds semantic segmentation. In CVPR, 9601–9610.
- Bytetrack: Multi-object tracking by associating every detection box. In ECCV. Springer.
- LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensors. arXiv preprint arXiv:2205.15410.
- Gait Recognition in the Wild with Dense 3D Representations and A Benchmark. In CVPR, 20228–20237.
- Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentation. CVPR, 9934–9943.
- Gait recognition in the wild: A benchmark. In ICCV, 14789–14799.