Papers
Topics
Authors
Recent
Search
2000 character limit reached

ONOT: a High-Quality ICAO-compliant Synthetic Mugshot Dataset

Published 17 Apr 2024 in cs.CV | (2404.11236v1)

Abstract: Nowadays, state-of-the-art AI-based generative models represent a viable solution to overcome privacy issues and biases in the collection of datasets containing personal information, such as faces. Following this intuition, in this paper we introduce ONOT, a synthetic dataset specifically focused on the generation of high-quality faces in adherence to the requirements of the ISO/IEC 39794-5 standards that, following the guidelines of the International Civil Aviation Organization (ICAO), defines the interchange formats of face images in electronic Machine-Readable Travel Documents (eMRTD). The strictly controlled and varied mugshot images included in ONOT are useful in research fields related to the analysis of face images in eMRTD, such as Morphing Attack Detection and Face Quality Assessment. The dataset is publicly released, in combination with the generation procedure details in order to improve the reproducibility and enable future extensions.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (51)
  1. Privacy preserving synthetic data release using deep learning. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2018, Dublin, Ireland, September 10–14, 2018, Proceedings, Part I 18, pages 510–526. Springer, 2019.
  2. AUTOMATIC1111. Stable Diffusion Web UI, 2022.
  3. Digiface-1m: 1 million digital face images for face recognition. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 3526–3535, 2023.
  4. Revelio: A modular and effective framework for reproducible training and evaluation of morphing attack detectors. IEEE Access, 2023.
  5. A double siamese framework for differential morphing attack detection. Sensors, 21(10):3466, 2021.
  6. Idiff-face: Synthetic-based face recognition through fizzy identity-conditioned diffusion model. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 19650–19661, 2023.
  7. Sface: Privacy-friendly and accurate face recognition using synthetic data. In 2022 IEEE International Joint Conference on Biometrics (IJCB), pages 1–11. IEEE, 2022.
  8. Unsupervised face recognition using unlabeled synthetic data. In 2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition (FG), pages 1–8. IEEE, 2023.
  9. Synthetic data for face recognition: Current state and future prospects. Image and Vision Computing, page 104688, 2023.
  10. K. W. Bowyer. Face recognition technology: security versus privacy. IEEE Technology and society magazine, 23(1):9–19, 2004.
  11. C. Bron and J. Kerbosch. Algorithm 457: finding all cliques of an undirected graph. Communications of the ACM, 16(9):575–577, 1973.
  12. C. Busch. Standards for biometric presentation attack detection. In Handbook of Biometric Anti-Spoofing: Presentation Attack Detection and Vulnerability Assessment, pages 571–583. Springer, 2023.
  13. Accuracy comparison across face recognition algorithms: Where are we on measuring race bias? IEEE transactions on biometrics, behavior, and identity science, 3(1):101–111, 2020.
  14. F. Cazals and C. Karande. A note on the problem of reporting maximal cliques. Theoretical computer science, 407(1-3):564–568, 2008.
  15. Privacy-friendly synthetic data for the development of face morphing attack detectors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1606–1617, 2022.
  16. Arcface: Additive angular margin loss for deep face recognition. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4690–4699, 2019.
  17. Disentangled and controllable face image generation via 3d imitative-contrastive learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5154–5163, 2020.
  18. P. Dhariwal and A. Nichol. Diffusion models beat gans on image synthesis. Advances in neural information processing systems, 34:8780–8794, 2021.
  19. Face morphing detection in the presence of printing/scanning and heterogeneous image sources. IET Biometrics, 10(3):290–303, 2021.
  20. Face image quality assessment in electronic id documents. IEEE Access, 10:77744–77758, 2022.
  21. Fast and accurate facial landmark localization in depth images for in-car applications. In Image Analysis and Processing-ICIAP 2017: 19th International Conference, Catania, Italy, September 11-15, 2017, Proceedings, Part I 19, pages 539–549. Springer, 2017.
  22. Generative adversarial networks. Communications of the ACM, 63(11):139–144, 2020.
  23. ISO/IEC 19794-5 — Information technology — Biometric data interchange formats — Part 5: Face image data. Standard, International Organization for Standardization, 2011.
  24. ISO/IEC 39794-5 — Information technology — Extensible biometric data interchange formats — Part 5: Face image data. Standard, International Organization for Standardization, 2019.
  25. Controllable inversion of black-box face recognition models via diffusion. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3167–3177, 2023.
  26. K. Karkkainen and J. Joo. Fairface: Face attribute dataset for balanced race, gender, and age for bias measurement and mitigation. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pages 1548–1558, 2021.
  27. Elucidating the design space of diffusion-based generative models. Advances in Neural Information Processing Systems, 35:26565–26577, 2022.
  28. Training generative adversarial networks with limited data. Advances in neural information processing systems, 33:12104–12114, 2020.
  29. An introduction to variational autoencoders. Foundations and Trends® in Machine Learning, 12(4):307–392, 2019.
  30. S. Li and W. Deng. Deep facial expression recognition: A survey. IEEE transactions on affective computing, 13(3):1195–1215, 2020.
  31. Sphereface: Deep hypersphere embedding for face recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 212–220, 2017.
  32. Dpm-solver++: Fast solver for guided sampling of diffusion probabilistic models. arXiv preprint arXiv:2211.01095, 2022.
  33. Gandiffface: Controllable generation of synthetic datasets for face recognition with realistic variations. arXiv preprint arXiv:2305.19962, 2023.
  34. Frcsyn-ongoing: Benchmarking and comprehensive evaluation of real and synthetic data to improve face recognition systems. Information Fusion, page 102322, 2024.
  35. A. Q. Nichol and P. Dhariwal. Improved denoising diffusion probabilistic models. In International Conference on Machine Learning, pages 8162–8171. PMLR, 2021.
  36. Bias in data-driven artificial intelligence systems—an introductory survey. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 10(3):e1356, 2020.
  37. Synface: Face recognition with synthetic data. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 10880–10890, 2021.
  38. Morphing attack detection-database, evaluation platform, and benchmarking. IEEE transactions on information forensics and security, 16:4336–4351, 2020.
  39. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 10684–10695, June 2022.
  40. Face image quality assessment: A literature survey. ACM Computing Surveys (CSUR), 54(10s):1–49, 2022.
  41. Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 815–823, 2015.
  42. Web-scale training for face identification. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2746–2754, 2015.
  43. Facial expression recognition. Handbook of face recognition, pages 487–519, 2011.
  44. The worst-case time complexity for generating all maximal cliques and computational experiments. Theoretical computer science, 363(1):28–42, 2006.
  45. Face morphing attack generation and detection: A comprehensive survey. IEEE transactions on technology and society, 2(3):128–145, 2021.
  46. A. Wolf. ICAO: Portrait quality (reference facial images for MRTD), version 1.0. standard. International Civil Aviation Organization, 2018.
  47. Fake it till you make it: face analysis in the wild using synthetic data alone. In Proceedings of the IEEE/CVF international conference on computer vision, pages 3681–3691, 2021.
  48. Y. Wu and Q. Ji. Facial landmark detection: A literature survey. International Journal of Computer Vision, 127:115–142, 2019.
  49. Joint face detection and alignment using multitask cascaded convolutional networks. IEEE signal processing letters, 23(10):1499–1503, 2016.
  50. Face recognition: A literature survey. ACM computing surveys (CSUR), 35(4):399–458, 2003.
  51. Webface260m: A benchmark unveiling the power of million-scale deep face recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10492–10502, 2021.
Citations (2)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

Sign Up for Free