Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Masked Attribute Description Embedding for Cloth-Changing Person Re-identification (2401.05646v3)

Published 11 Jan 2024 in cs.CV

Abstract: Cloth-changing person re-identification (CC-ReID) aims to match persons who change clothes over long periods. The key challenge in CC-ReID is to extract clothing-independent features, such as face, hairstyle, body shape, and gait. Current research mainly focuses on modeling body shape using multi-modal biological features (such as silhouettes and sketches). However, it does not fully leverage the personal description information hidden in the original RGB image. Considering that there are certain attribute descriptions which remain unchanged after the changing of cloth, we propose a Masked Attribute Description Embedding (MADE) method that unifies personal visual appearance and attribute description for CC-ReID. Specifically, handling variable clothing-sensitive information, such as color and type, is challenging for effective modeling. To address this, we mask the clothing and color information in the personal attribute description extracted through an attribute detection model. The masked attribute description is then connected and embedded into Transformer blocks at various levels, fusing it with the low-level to high-level features of the image. This approach compels the model to discard clothing information. Experiments are conducted on several CC-ReID benchmarks, including PRCC, LTCC, Celeb-reID-light, and LaST. Results demonstrate that MADE effectively utilizes attribute description, enhancing cloth-changing person re-identification performance, and compares favorably with state-of-the-art methods. The code is available at https://github.com/moon-wh/MADE.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (52)
  1. Layer normalization. arXiv preprint arXiv:1607.06450, 2016.
  2. Cloth-changing person re-identification with self-attention. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 602–610, 2022.
  3. Learning disentangled features for person re-identification under clothes changing. ACM Transactions on Multimedia Computing, Communications and Applications, 19(6):1–21, 2023.
  4. Learning 3d shape feature for texture-insensitive person re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8146–8155, 2021a.
  5. Deep shape-aware person re-identification for overcoming moderate clothing changes. IEEE Transactions on Multimedia, 24:4285–4300, 2021b.
  6. Beyond appearance: a semantic controllable self-supervised learning framework for human-centric visual tasks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 15050–15061, 2023.
  7. Cross-modal knowledge adaptation for language-based person search. IEEE Transactions on Image Processing, 30:4057–4069, 2021c.
  8. Dcr-reid: Deep component reconstruction for cloth-changing person re-identification. IEEE Transactions on Circuits and Systems for Video Technology, 2023.
  9. Pedestrian attribute recognition at far distance. In Proceedings of the 22nd ACM international conference on Multimedia, pages 789–792, 2014.
  10. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020.
  11. Learning longterm representations for person re-identification using radio signals. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10699–10709, 2020.
  12. Eva-02: A visual representation for neon genesis. arXiv preprint arXiv:2303.11331, 2023.
  13. A semantic-aware attention and visual shielding network for cloth-changing person re-identification. arXiv preprint arXiv:2207.08387, 2022.
  14. Generative adversarial nets. Advances in neural information processing systems, 27, 2014.
  15. Clothes-changing person re-identification with rgb modality only. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1060–1069, 2022.
  16. Clothing-change feature augmentation for person re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 22066–22075, 2023.
  17. Transreid: Transformer-based object re-identification. In Proceedings of the IEEE/CVF international conference on computer vision, pages 15013–15022, 2021.
  18. Long short-term memory. Neural computation, 9(8):1735–1780, 1997.
  19. Fine-grained shape-appearance mutual learning for cloth-changing person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10513–10522, 2021.
  20. Celebrities-reid: A benchmark for clothes variation in long-term person re-identification. In 2019 International Joint Conference on Neural Networks (IJCNN), pages 1–8. IEEE, 2019.
  21. Clothing status awareness for long-term person re-identification. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 11895–11904, 2021.
  22. Cross-modal implicit relation reasoning and aligning for text-to-image person retrieval. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2787–2797, 2023.
  23. Cloth-changing person re-identification from a single image with gait prediction and regularization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14278–14287, 2022.
  24. Visual appearance and soft biometrics fusion for person re-identification using deep learning. IEEE Journal of Selected Topics in Signal Processing, 2023.
  25. Vibe: Video inference for human body pose and shape estimation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5253–5263, 2020.
  26. Identity-aware textual-visual matching with latent co-attention. In Proceedings of the IEEE International Conference on Computer Vision, pages 1890–1899, 2017a.
  27. Person search with natural language description. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1970–1979, 2017b.
  28. Improving person re-identification by attribute and identity learning. Pattern recognition, 95:151–161, 2019.
  29. Bag of tricks and a strong baseline for deep person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pages 0–0, 2019.
  30. Learning clothes-irrelevant cues for clothes-changing person re-identification. British Machine Vision Conference, 2022.
  31. Long-term cloth-changing person re-identification. In Proceedings of the Asian Conference on Computer Vision, 2020.
  32. Top-db-net: Top dropblock for activation enhancement in person re-identification. In 2020 25th International conference on pattern recognition (ICPR), pages 2980–2987. IEEE, 2021.
  33. Learning transferable visual models from natural language supervision. In International conference on machine learning, pages 8748–8763. PMLR, 2021.
  34. Person re-identification with a cloth-changing aware transformer. In 2022 International Joint Conference on Neural Networks (IJCNN), pages 1–8. IEEE, 2022.
  35. Adversarial representation learning for text-to-image matching. In Proceedings of the IEEE/CVF international conference on computer vision, pages 5814–5824, 2019.
  36. Iranet: Identity-relevance aware representation for cloth-changing person re-identification. Image and Vision Computing, 117:104335, 2022.
  37. Large-scale spatio-temporal person re-identification: Algorithms and benchmark. IEEE Transactions on Circuits and Systems for Video Technology, 32(7):4390–4403, 2021.
  38. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
  39. Faster person re-identification. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VIII, pages 275–292. Springer, 2020a.
  40. High-order information matters: Learning relation and topology for occluded person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 6449–6458, 2020b.
  41. Identity-sensitive knowledge propagation for cloth-changing person re-identification. In 2022 IEEE International Conference on Image Processing (ICIP), pages 1016–1020. IEEE, 2022.
  42. Adversarial feature disentanglement for long-term person re-identification. In IJCAI, pages 1201–1207, 2021.
  43. Spatial temporal graph convolutional networks for skeleton-based action recognition. In Proceedings of the AAAI conference on artificial intelligence, 2018.
  44. Person re-identification by contour sketch under moderate clothing change. IEEE transactions on pattern analysis and machine intelligence, 43(6):2029–2046, 2019.
  45. Good is bad: Causality inspired cloth-debiasing for cloth-changing person re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1472–1481, 2023.
  46. Deep learning for person re-identification: A survey and outlook. IEEE transactions on pattern analysis and machine intelligence, 44(6):2872–2893, 2021.
  47. Multi-biometric unified network for cloth-changing person re-identification. IEEE Transactions on Image Processing, 32:4555–4566, 2023.
  48. Learning spatial-temporal representations over walking tracklet for long-term person re-identification in the wild. IEEE Transactions on Multimedia, 23:3562–3576, 2020.
  49. Deep cross-modal projection learning for image-text matching. In Proceedings of the European conference on computer vision (ECCV), pages 686–701, 2018.
  50. Joint discriminative and generative learning for person re-identification. In proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2138–2147, 2019.
  51. Random erasing data augmentation. In Proceedings of the AAAI conference on artificial intelligence, pages 13001–13008, 2020.
  52. Omni-scale feature learning for person re-identification. In Proceedings of the IEEE/CVF international conference on computer vision, pages 3702–3712, 2019.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Chunlei Peng (20 papers)
  2. Boyu Wang (72 papers)
  3. Decheng Liu (22 papers)
  4. Nannan Wang (106 papers)
  5. Ruimin Hu (17 papers)
  6. Xinbo Gao (194 papers)
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Github Logo Streamline Icon: https://streamlinehq.com

GitHub

  1. GitHub - moon-wh/MADE (13 stars)