Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Kinship Representation Learning with Face Componential Relation (2304.04546v5)

Published 10 Apr 2023 in cs.CV

Abstract: Kinship recognition aims to determine whether the subjects in two facial images are kin or non-kin, which is an emerging and challenging problem. However, most previous methods focus on heuristic designs without considering the spatial correlation between face images. In this paper, we aim to learn discriminative kinship representations embedded with the relation information between face components (e.g., eyes, nose, etc.). To achieve this goal, we propose the Face Componential Relation Network, which learns the relationship between face components among images with a cross-attention mechanism, which automatically learns the important facial regions for kinship recognition. Moreover, we propose Face Componential Relation Network (FaCoRNet), which adapts the loss function by the guidance from cross-attention to learn more discriminative feature representations. The proposed FaCoRNet outperforms previous state-of-the-art methods by large margins for the largest public kinship recognition FIW benchmark.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. Principal component analysis. Wiley interdisciplinary reviews: computational statistics, 2(4):433–459, 2010.
  2. A simple framework for contrastive learning of visual representations. In International conference on machine learning, pages 1597–1607. PMLR, 2020.
  3. Deep discriminant generation-shared feature learning for image-based kinship verification. Signal Processing: Image Communication, 101:116543, 2022.
  4. Fusing robust face region descriptors via multiple metric learning for face recognition in the wild. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3554–3561, 2013.
  5. A unified approach to kinship verification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(8):2851–2857, 2020.
  6. Lateralization of kin recognition signals in the human face. Journal of vision, 10(8):9–9, 2010.
  7. Who do i look like? determining parent-offspring resemblance via gated autoencoders. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1757–1764, 2014.
  8. Arcface: Additive angular margin loss for deep face recognition. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4690–4699, 2019.
  9. Hamdi Dibeklioglu. Visual transformation aided contrastive learning for video-based kinship verification. In Proceedings of the IEEE International Conference on Computer Vision, pages 2459–2468, 2017.
  10. Trunk-branch ensemble convolutional neural networks for video-based face recognition. IEEE transactions on pattern analysis and machine intelligence, 40(4):1002–1014, 2017.
  11. From face recognition to kinship verification: An adaptation approach. In Proceedings of the IEEE international conference on computer vision workshops, pages 1590–1598, 2017.
  12. Efficient nearest neighbor search in high dimensional hamming space. Pattern Recognition, 99:107082, 2020.
  13. A multi-task comparator framework for kinship verification. In 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), pages 863–867. IEEE, 2020.
  14. Labeled faces in the wild: A database forstudying face recognition in unconstrained environments. In Workshop on faces in’Real-Life’Images: detection, alignment, and recognition, 2008.
  15. Adaptively weighted k-tuple metric network for kinship verification. IEEE Transactions on Cybernetics, 2022.
  16. Supervised contrastive learning. Advances in Neural Information Processing Systems, 33:18661–18673, 2020.
  17. Adaface: Quality adaptive margin for face recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 18750–18759, 2022.
  18. Meta-mining discriminative samples for kinship verification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 16135–16144, 2021.
  19. Graph-based kinship reasoning network. In 2020 IEEE international conference on multimedia and expo (ICME), pages 1–6. IEEE, 2020.
  20. Weighted graph embedding-based metric learning for kinship verification. IEEE Transactions on Image Processing, 28(3):1149–1162, 2018.
  21. Styledna: A high-fidelity age and gender aware kinship face synthesizer. In 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021), pages 1–8. IEEE, 2021.
  22. Neighborhood repulsed metric learning for kinship verification. IEEE transactions on pattern analysis and machine intelligence, 36(2):331–345, 2013.
  23. Challenge report recognizing families in the wild data challenge. In 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), pages 868–871. IEEE, 2020.
  24. Agedb: the first manually collected, in-the-wild age database. In proceedings of the IEEE conference on computer vision and pattern recognition workshops, pages 51–59, 2017.
  25. Maximally compact and separated features with regular polytope networks. In CVPR Workshops, pages 46–53, 2019.
  26. Survey on the analysis and modeling of visual kinship: A decade in the making. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(8):4432–4453, 2022.
  27. Visual kinship recognition of families in the wild (fiw). IEEE Transactions on Pattern Analysis and Machine Intelligence Special Issue: The Computational Face, 2017.
  28. Visual kinship recognition of families in the wild. TPAMI, 2018.
  29. Knowledge-based tensor subspace analysis system for kinship verification. Neural Networks, 151:222–237, 2022.
  30. Andrei Shadrikov. Achieving better kinship recognition through better baseline. In 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), pages 872–876. IEEE, 2020.
  31. Can faces verify blood-relations? In 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS), pages 105–112. IEEE, 2012.
  32. Kinmix: A data augmentation approach for kinship verification. In 2020 IEEE international conference on multimedia and expo (ICME), pages 1–6. IEEE, 2020.
  33. Ser-fiq: Unsupervised estimation of face image quality based on stochastic embedding robustness. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5651–5660, 2020.
  34. Haibin Yan. Learning discriminative compact binary face descriptor for kinship verification. Pattern Recognition Letters, 117:146–152, 2019.
  35. Discriminative multimetric learning for kinship verification. IEEE Transactions on Information forensics and security, 9(7):1169–1178, 2014.
  36. Deep fusion siamese network for automatic kinship verification. In 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), pages 892–899. IEEE, 2020.
  37. Deep kinship verification and retrieval based on fusion siamese neural network. In 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021), pages 1–8. IEEE, 2021.
  38. Kinship verification with deep convolutional neural networks. In The British Machine Vision Conference. British machine vision conference. BMVA Press, 2015.
  39. Joint face detection and alignment using multitask cascaded convolutional networks. IEEE signal processing letters, 23(10):1499–1503, 2016.
  40. Supervised contrastive learning for facial kinship recognition. In 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021), 2021.
  41. Gabor-based gradient orientation pyramid for kinship verification under uncontrolled environments. In Proceedings of the 20th ACM international conference on Multimedia, pages 725–728, 2012.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now