Heterogeneous Face Recognition Using Domain Invariant Units (2404.14343v1)
Abstract: Heterogeneous Face Recognition (HFR) aims to expand the applicability of Face Recognition (FR) systems to challenging scenarios, enabling the matching of face images across different domains, such as matching thermal images to visible spectra. However, the development of HFR systems is challenging because of the significant domain gap between modalities and the lack of availability of large-scale paired multi-channel data. In this work, we leverage a pretrained face recognition model as a teacher network to learn domaininvariant network layers called Domain-Invariant Units (DIU) to reduce the domain gap. The proposed DIU can be trained effectively even with a limited amount of paired training data, in a contrastive distillation framework. This proposed approach has the potential to enhance pretrained models, making them more adaptable to a wider range of variations in data. We extensively evaluate our approach on multiple challenging benchmarks, demonstrating superior performance compared to state-of-the-art methods.
- “Labeled faces in the wild: A survey,” Advances in face detection and facial image analysis, vol. 1, pp. 189–248, 2016.
- “Heterogeneous face recognition using kernel prototype similarities,” IEEE transactions on pattern analysis and machine intelligence, vol. 35, no. 6, pp. 1410–1422, 2012.
- “Wasserstein CNN: Learning invariant features for Nir-Vis face recognition,” IEEE transactions on pattern analysis and machine intelligence, vol. 41, no. 7, pp. 1761–1773, 2018.
- “Heterogeneous face recognition from local structures of normalized appearance,” in International Conference on Biometrics. Springer, 2009, pp. 209–218.
- “Matching forensic sketches to mug shot photos,” IEEE transactions on pattern analysis and machine intelligence, vol. 33, no. 3, pp. 639–646, 2010.
- “Multi-view discriminant analysis,” IEEE transactions on pattern analysis and machine intelligence, vol. 38, no. 1, pp. 188–194, 2015.
- “Learning invariant deep representation for Nir-Vis face recognition,” in Thirty-First AAAI Conference on Artificial Intelligence, 2017.
- “DVG-face: Dual variational generation for heterogeneous face recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021.
- “Generative adversarial network-based synthesis of visible faces from polarimetric thermal faces,” in 2017 IEEE International Joint Conference on Biometrics (IJCB). IEEE, 2017, pp. 100–107.
- “Heterogeneous face recognition using domain specific units,” IEEE Transactions on Information Forensics and Security, vol. 14, no. 7, pp. 1803–1816, 2018.
- “Prepended domain transformer: Heterogeneous face recognition without bells and whistles,” IEEE Transactions on Information Forensics and Security, 2022.
- “Bridging the Gap: Heterogeneous face recognition with conditional adaptive instance modulation,” in 2023 International Joint Conference on Biometrics (IJCB). IEEE, 2023.
- “Distilling the knowledge in a neural network,” arXiv preprint arXiv:1503.02531, 2015.
- “Fitnets: Hints for thin deep nets,” arXiv preprint arXiv:1412.6550, 2014.
- “Contrastive representation distillation,” arXiv preprint arXiv:1910.10699, 2019.
- “Adaface: Quality adaptive margin for face recognition,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 18750–18759.
- “Webface260m: A benchmark unveiling the power of million-scale deep face recognition,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 10492–10502.
- “Continuously reproducing toolchains in pattern recognition and machine learning experiments,” in International Conference on Machine Learning (ICML), Aug. 2017.
- “Bob: a free signal processing and machine learning toolbox for researchers,” in 20th ACM Conference on Multimedia Systems (ACMMM), Nara, Japan, Oct. 2012.
- “A polarimetric thermal database for face recognition research,” in Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2016, pp. 119–126.
- “A comprehensive database for benchmarking imaging systems,” IEEE transactions on pattern analysis and machine intelligence, vol. 42, no. 3, pp. 509–520, 2018.
- “SCface–surveillance cameras face database,” Multimedia tools and applications, vol. 51, no. 3, pp. 863–879, 2011.
- “Heterogeneous face recognition using inter-session variability modelling,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2016, pp. 111–118.
- “A light CNN for deep face representation with noisy labels,” IEEE Transactions on Information Forensics and Security, vol. 13, no. 11, pp. 2884–2896, 2018.
- “Dual variational generation for low shot heterogeneous face recognition,” in Advances in Neural Information Processing Systems, 2019.