Enhancing Fingerprint Image Synthesis with GANs, Diffusion Models, and Style Transfer Techniques (2403.13916v1)
Abstract: We present novel approaches involving generative adversarial networks and diffusion models in order to synthesize high quality, live and spoof fingerprint images while preserving features such as uniqueness and diversity. We generate live fingerprints from noise with a variety of methods, and we use image translation techniques to translate live fingerprint images to spoof. To generate different types of spoof images based on limited training data we incorporate style transfer techniques through a cycle autoencoder equipped with a Wasserstein metric along with Gradient Penalty (CycleWGAN-GP) in order to avoid mode collapse and instability. We find that when the spoof training data includes distinct spoof characteristics, it leads to improved live-to-spoof translation. We assess the diversity and realism of the generated live fingerprint images mainly through the Fr\'echet Inception Distance (FID) and the False Acceptance Rate (FAR). Our best diffusion model achieved a FID of 15.78. The comparable WGAN-GP model achieved slightly higher FID while performing better in the uniqueness assessment due to a slightly lower FAR when matched against the training data, indicating better creativity. Moreover, we give example images showing that a DDPM model clearly can generate realistic fingerprint images.
- Sébastien Marcel, Julian Fierrez and Nicholas Evans. Handbook of biometric anti-spoofing: Presentation attack detection and vulnerability assessment. Book, Series: Advances in Computer Vision and Pattern Recognition, Editors: Marcel, S., Fierrez, J., Evans, N. (Eds.)2023, 3rd ed. Springer, ISBN: 978-981-19-5288-3. Springer, 2023.
- Jonathan Ho, Ajay Jain and Pieter Abbeel. “Denoising diffusion probabilistic models”. In H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan and H. Lin, editors, Advances in Neural Information Processing Systems, volume 33, pages 6840–6851. Curran Associates, Inc., 2020. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2020/file/4c5bcfec8584af0d967f1ab10179ca4b-Paper.pdf.
- “GANs trained by a two time-scale update rule converge to a local nash equilibrium”. In I. Guyon, U. Von Luxburg, S. Bengio et al., editors, Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc., 2017. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2017/file/8a1d694707eb0fefe65871369074926d-Paper.pdf.
- “Demystifying MMD GANs”. In International Conference on Learning Representations, 2018. [Online]. Available: https://openreview.net/forum?id=r1lUOzWCW.
- Handbook of Fingerprint Recognition. Springer Professional Computing. Springer London, 2009.
- “Improved precision and recall metric for assessing generative models”. In H. Wallach, H. Larochelle, A. Beygelzimer et al., editors, Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc., 2019. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2019/file/0234c510bc6d908b28c70ff313743079-Paper.pdf.
- “Reliable fidelity and diversity metrics for generative models”. In Hal Daumé III and Aarti Singh, editors, Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research, pages 7176–7185. PMLR, 13–18 Jul 2020. [Online]. Available: https://proceedings.mlr.press/v119/naeem20a.html.
- “Improved techniques for training GANs”. In D. Lee, M. Sugiyama, U. Luxburg, I. Guyon and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 29. Curran Associates, Inc., 2016. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2016/file/8a3363abe792db2d8761d6403605aeb7-Paper.pdf.
- “Synthetic fingerprint-image generation”. In Proceedings 15th International Conference on Pattern Recognition. ICPR-2000, volume 3, pages 471–474 vol.3, 2000.
- R. Cappelli, D. Maio and D. Maltoni. “Synthetic fingerprint-database generation”. In 2002 International Conference on Pattern Recognition, volume 3, pages 744–747 vol.3, 2002.
- “A synthetic fingerprint generation method and its implementation.”. Journal of Software, vol. 18, no. 3, 517 – 526, 2007.
- “An iris image synthesis method based on PCA and super-resolution”. In Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004., volume 4, pages 471–474 Vol.4, 2004.
- “Synthesis of iris images using markov random fields”. In 2005 13th European Signal Processing Conference, pages 1–4, 2005.
- “Fingerprint image reconstruction from standard templates”. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 9, 1489–1503, 2007.
- “Fingerprint reconstruction method using partial differential equation and exemplar-based inpainting methods”. In 2007 Biometrics Symposium, pages 1–6, 2007.
- Arun Ross, Jidnya Shah and Anil K. Jain. “From template to image: Reconstructing fingerprints from minutiae points”. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 4, 544–560, 2007.
- “FM model based fingerprint reconstruction from minutiae template”. In Advances in Biometrics: Third International Conference, ICB 2009, Alghero, Italy, June 2-5, 2009. Proceedings 3, pages 544–553. Springer, 2009.
- “Fingerprint reconstruction: From minutiae to phase”. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 2, 209–223, 2011.
- “Learning fingerprint reconstruction: From minutiae to image”. IEEE Transactions on Information Forensics and Security, vol. 10, no. 1, 104–117, 2015.
- Peter Johnson, Fang Hua and Stephanie Schuckers. “Texture modeling for synthetic fingerprint generation”. In 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops, pages 154–159, 2013.
- “Generative Adversarial Nets”. In Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence and K.Q. Weinberger, editors, Advances in Neural Information Processing Systems, volume 27. Curran Associates, Inc., 2014. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2014/file/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf.
- “Finger-GAN: Generating realistic fingerprint images using connectivity imposed GAN”. CoRR, vol. abs/1812.10482, 2018. [Online]. Available: http://arxiv.org/abs/1812.10482.
- “Fingerprint generation and presentation attack detection using deep neural networks”. In 2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR), pages 375–378, 2019.
- Masud An-Nur Islam Fahim and Ho Yub Jung. “A lightweight GAN network for large scale fingerprint generation”. IEEE Access, vol. 8, 92918–92928, 2020.
- Chenhao Zhong, Pengxin Xu and Longsheng Zhu. “A deep convolutional generative adversarial network-based fake fingerprint generation method”. In 2021 IEEE International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI), pages 63–67, 2021.
- Alex Krizhevsky, Ilya Sutskever and Geoffrey E Hinton. “Imagenet classification with deep convolutional neural networks”. In F. Pereira, C.J. Burges, L. Bottou and K.Q. Weinberger, editors, Advances in Neural Information Processing Systems, volume 25. Curran Associates, Inc., 2012. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf.
- “Very deep convolutional networks for large-scale image recognition”. In Yoshua Bengio and Yann LeCun, editors, 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015. [Online]. Available: http://arxiv.org/abs/1409.1556.
- “Adaptive deep convolutional GAN for fingerprint sample synthesis”. In 2021 IEEE 4th International Conference on Advanced Information and Communication Technologies (AICT), pages 193–196, 2021.
- “High fidelity fingerprint generation: Quality, uniqueness, and privacy”. In 2021 IEEE International Conference on Image Processing (ICIP), pages 3018–3022, 2021.
- “Unpaired image-to-image translation using cycle-consistent adversarial networks”. In 2017 IEEE International Conference on Computer Vision (ICCV), pages 2242–2251, 2017.
- “Level three synthetic fingerprint generation”. In 2020 25th International Conference on Pattern Recognition (ICPR), pages 9250–9257, Los Alamitos, CA, USA, Jan 2021. IEEE Computer Society. [Online]. Available: https://doi.ieeecomputersociety.org/10.1109/ICPR48806.2021.9412304.
- Ataher Sams, Homaira Shomee and S. Rahman. “HQ-finGAN: High-quality synthetic fingerprint generation using GANs”. Circuits, Systems, and Signal Processing, vol. 41, 1–16, Jul 2022.
- Y. Zhu, X. Yin and J. Hu. “FingerGAN: A constrained fingerprint generation scheme for latent fingerprint enhancement”. IEEE Transactions on Pattern Analysis Machine Intelligence, vol. 45, no. 07, 8358–8371, Jul 2023.
- “SpoofGAN: Synthetic fingerprint spoof images”. IEEE Transactions on Information Forensics and Security, vol. 18, 730–743, 2023.
- Furkan Luleci, F. Necati Catbas and Onur Avci. “CycleGAN for undamaged-to-damaged domain translation for structural health monitoring and damage detection”. Mechanical Systems and Signal Processing, vol. 197, 110370, 2023. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0888327023002777.
- Diego Andre Figueroa Llamosas and Weizhong Tang. Fingerprint Synthesis Using Deep Generative Models. ISSN 1404-6342, LUTFMA-3502-2023, Lund University, Mathematics, 2023.
- “Diffusion models beat GANs on image synthesis”. In M. Ranzato, A. Beygelzimer, Y. Dauphin, P.S. Liang and J. Wortman Vaughan, editors, Advances in Neural Information Processing Systems, volume 34, pages 8780–8794. Curran Associates, Inc., 2021. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2021/file/49ad23d1ec9fa4bd8d77d02681df5cfa-Paper.pdf.
- “Improved denoising diffusion probabilistic models”. In Marina Meila and Tong Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proceedings of Machine Learning Research, pages 8162–8171. PMLR, 18–24 Jul 2021. [Online]. Available: https://proceedings.mlr.press/v139/nichol21a.html.
- Cédric Villani. The Wasserstein distances, pages 93–111. Springer Berlin Heidelberg, Berlin, Heidelberg, 2009. [Online]. Available: https://doi.org/10.1007/978-3-540-71050-9_6.
- “Improved training of wasserstein GANs”. In I. Guyon, U. Von Luxburg, S. Bengio et al., editors, Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc., 2017. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2017/file/892c3b1c6dccd52936e27cbd0ff683d6-Paper.pdf.
- Martin Arjovsky, Soumith Chintala and Léon Bottou. “Wasserstein generative adversarial networks”. In Doina Precup and Yee Whye Teh, editors, Proceedings of the 34th International Conference on Machine Learning, volume 70 of Proceedings of Machine Learning Research, pages 214–223. PMLR, 06–11 Aug 2017. [Online]. Available: https://proceedings.mlr.press/v70/arjovsky17a.html.
- “Assessing generative models via precision and recall”. Advances in neural information processing systems, vol. 31, 2018.
- “Deep residual learning for image recognition”. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770–778, Los Alamitos, CA, USA, Jun 2016. IEEE Computer Society. [Online]. Available: https://doi.ieeecomputersociety.org/10.1109/CVPR.2016.90.
- Dmitry Ulyanov, Andrea Vedaldi and Victor S. Lempitsky. “Instance normalization: The missing ingredient for fast stylization”. CoRR, vol. abs/1607.08022, 2016. [Online]. Available: http://arxiv.org/abs/1607.08022.