Face Morphing Attack Detection with Denoising Diffusion Probabilistic Models (2306.15733v1)
Abstract: Morphed face images have recently become a growing concern for existing face verification systems, as they are relatively easy to generate and can be used to impersonate someone's identity for various malicious purposes. Efficient Morphing Attack Detection (MAD) that generalizes well across different morphing techniques is, therefore, of paramount importance. Existing MAD techniques predominantly rely on discriminative models that learn from examples of bona fide and morphed images and, as a result, often exhibit sub-optimal generalization performance when confronted with unknown types of morphing attacks. To address this problem, we propose a novel, diffusion-based MAD method in this paper that learns only from the characteristics of bona fide images. Various forms of morphing attacks are then detected by our model as out-of-distribution samples. We perform rigorous experiments over four different datasets (CASIA-WebFace, FRLL-Morphs, FERET-Morphs and FRGC-Morphs) and compare the proposed solution to both discriminatively-trained and once-class MAD models. The experimental results show that our MAD model achieves highly competitive results on all considered datasets.
- GANomaly: Semi-supervised Anomaly Detection via Adversarial Training”. In ACCV, 2019.
- MixFaceNets: Extremely Efficient Face Recognition Networks. In IEEE IJCB, 2021.
- Diffusion Models in Vision: A Survey. arXiv:2209.04747, 2022.
- On the Generalization of Detecting Face Morphing Attacks as Anomalies: Novelty vs. Outlier Detection. In IEEE BTAS, 2019.
- Privacy-Friendly Synthetic Data for the Development of Face Morphing Attack Detectors. IEEE CVPRW, 2022.
- MorGAN: Recognition Vulnerability and Attack Detectability of Face Morphing Attacks Created by Generative Adversarial Network. In IEEE BTAS, 2018.
- PW-MAD: Pixel-Wise Supervision for Generalized Face Morphing Attack Detection. In Springer AVC, 2021.
- L. DeBruine and B. Jones. Face Research Lab London Set, 2017.
- RetinaFace: Single-Shot Multi-Level Face Localisation in the Wild. In IEEE CVPR, 2020.
- P. Dhariwal and A. Nichol. Diffusion Models Beat GANs on Image Synthesis. In NeurIPS, 2021.
- Unsupervised Face Morphing Attack Detection via Self-paced Anomaly Detection. In IJCB, 2022.
- On the Effects of Image Alterations on Face Recognition Accuracy, pages 195–222. Springer International Publishing, 2016.
- Strengths and Weaknesses of Deep Learning Models for Face Recognition against Image Degradations. IET Biometrics, 2018.
- Denoising Diffusion Probabilistic Models. In NIPS, 2020.
- SYN-MAD 2022: Competition on Face Morphing Attack Detection Based on Privacy-aware Synthetic Training Data. In IJCB, 2022.
- Differential Anomaly Detection for Facial Images. In IEEE WIFS, 2021.
- Elucidating the Design Space of Diffusion-Based Generative Models. In NIPS, 2022.
- I. Loshchilov and F. Hutter. Decoupled Weight Decay Regularization. In ICLR, 2019.
- DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps. CoRR, abs/2206.00927, 2022.
- Dempster-Shafer Theory for Fusing Face Morphing Detectors. In EUSIPCO, 2019.
- T2V-DDPM: Thermal to Visible Face Translation using Denoising Diffusion Probabilistic Models, 2022.
- Extended StirTrace benchmarking of biometric and forensic qualities of morphed face images. IET Biometrics, 2018.
- A. Q. Nichol and P. Dhariwal. Improved denoising diffusion probabilistic models. In ICML, 2021.
- A Comparative Study of Texture Measures With Classification Based on Featured Distributions. Pattern Recognition, 1996.
- V. Ojansivu and J. Heikkilä. Blur Insensitive Texture Classification Using Local Phase Quantization. In Img. and Sig. Processing, 2008.
- Overview of the face recognition grand challenge. In CVPR, volume 1, pages 947–954 vol. 1, 2005.
- The FERET database and evaluation procedure for face-recognition algorithms. Image and Vision Computing, 16(5):295–306, 1998.
- Fast Unsupervised Brain Anomaly Detection and Segmentation with Diffusion Models. In MICCAI, 2022.
- Transferable Deep-CNN Features for Detecting Digital and Print-Scanned Morphed Face Images. In IEEE CVPRW, 2017.
- Detecting Face Morphing Attacks with Collaborative Representation of Steerable Features. In CVIP, 2020.
- High-Resolution Image Synthesis With Latent Diffusion Models. In CVPR, 2022.
- Palette: Image-to-Image Diffusion Models. In ACM SIGGRAPH, 2022.
- PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modifications. In ICLR, 2017.
- Vulnerability Analysis of Face Morphing Attacks from Landmarks and Generative Adversarial Networks. International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020.
- Detection of Face Morphing Attacks Based on PRNU Analysis. IEEE TBBIS, 2019.
- On the vulnerability of face recognition systems towards morphed face attacks. In IWBF, 2017.
- Face Recognition Systems Under Morphing Attacks: A Survey. IEEE Access, 2019.
- Reflection Analysis for Face Morphing Attack Detection. In EUSIPCO, 2018.
- Denoising Diffusion Implicit Models. In ICLR, 2021.
- Morphing Detection Using a General-Purpose Face Recognition System. In EUSIPCO, 2018.
- Diffusion Models for Medical Anomaly Detection. In MICCAI, 2022.
- AnoDDPM: Anomaly Detection with Denoising Diffusion Probabilistic Models using Simplex Noise. In CVPRW, 2022.
- Learning Face Representation from Scratch. CoRR, abs/1411.7923, 2014.
- S. Zagoruyko and N. Komodakis. Wide Residual Networks. CoRR, abs/1605.07146, 2016.
- Reconstruction by Inpainting for Visual Anomaly Detection. Patt. Rec., 2021.