Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Study on the Impact of Face Image Quality on Face Recognition in the Wild (2307.02679v1)

Published 5 Jul 2023 in cs.CV

Abstract: Deep learning has received increasing interests in face recognition recently. Large quantities of deep learning methods have been proposed to handle various problems appeared in face recognition. Quite a lot deep methods claimed that they have gained or even surpassed human-level face verification performance in certain databases. As we know, face image quality poses a great challenge to traditional face recognition methods, e.g. model-driven methods with hand-crafted features. However, a little research focus on the impact of face image quality on deep learning methods, and even human performance. Therefore, we raise a question: Is face image quality still one of the challenges for deep learning based face recognition, especially in unconstrained condition. Based on this, we further investigate this problem on human level. In this paper, we partition face images into three different quality sets to evaluate the performance of deep learning methods on cross-quality face images in the wild, and then design a human face verification experiment on these cross-quality data. The result indicates that quality issue still needs to be studied thoroughly in deep learning, human own better capability in building the relations between different face images with large quality gaps, and saying deep learning method surpasses human-level is too optimistic.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. M. A. Turk and A. P. Pentland, “Face recognition using eigenfaces,” in Computer Vision and Pattern Recognition, 1991. Proceedings CVPR’91., IEEE Computer Society Conference on.   IEEE, 1991, pp. 586–591.
  2. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, “Eigenfaces vs. fisherfaces: Recognition using class specific linear projection,” Yale University New Haven United States, Tech. Rep., 1997.
  3. T. Hassner, S. Harel, E. Paz, and R. Enbar, “Effective face frontalization in unconstrained images,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 4295–4304.
  4. B. Wang, W. Li, W. Yang, and Q. Liao, “Illumination normalization based on weber’s law with application to face recognition,” IEEE Signal Processing Letters, vol. 18, no. 8, pp. 462–465, 2011.
  5. F. Schroff, D. Kalenichenko, and J. Philbin, “Facenet: A unified embedding for face recognition and clustering,” in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015, pp. 815–823.
  6. C. Lu and X. Tang, “Surpassing human-level face verification performance on lfw with gaussianface.” in AAAI, 2015, pp. 3811–3819.
  7. Y. Wen, K. Zhang, Z. Li, and Y. Qiao, “A discriminative feature learning approach for deep face recognition,” in European Conference on Computer Vision.   Springer, 2016, pp. 499–515.
  8. W. Liu, Y. Wen, Z. Yu, M. Li, B. Raj, and L. Song, “Sphereface: Deep hypersphere embedding for face recognition,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 2017.
  9. H. Wang, Y. Wang, Z. Zhou, X. Ji, Z. Li, D. Gong, J. Zhou, and W. Liu, “Cosface: Large margin cosine loss for deep face recognition,” arXiv preprint arXiv:1801.09414, 2018.
  10. J. Deng, J. Guo, and S. Zafeiriou, “Arcface: Additive angular margin loss for deep face recognition,” arXiv preprint arXiv:1801.07698, 2018.
  11. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, “Labeled faces in the wild: A database for studying face recognition in unconstrained environments,” Technical Report 07-49, University of Massachusetts, Amherst, Tech. Rep., 2007.
  12. S. Liao, Z. Lei, D. Yi, and S. Z. Li, “A benchmark study of large-scale unconstrained face recognition,” in Biometrics (IJCB), 2014 IEEE International Joint Conference on.   IEEE, 2014, pp. 1–8.
  13. N. Zhang and W. Deng, “Fine-grained lfw database,” in Biometrics (ICB), 2016 International Conference on.   IEEE, 2016, pp. 1–6.
  14. G. Guo and N. Zhang, “What is the challenge for deep learning in unconstrained face recognition?” in Automatic Face & Gesture Recognition (FG 2018), 2018 13th IEEE International Conference on.   IEEE, 2018, pp. 436–442.
  15. B. F. Klare, B. Klein, E. Taborsky, A. Blanton, J. Cheney, K. Allen, P. Grother, A. Mah, and A. K. Jain, “Pushing the frontiers of unconstrained face detection and recognition: Iarpa janus benchmark a,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 1931–1939.
  16. H.-W. Ng and S. Winkler, “A data-driven approach to cleaning large face datasets,” in Image Processing (ICIP), 2014 IEEE International Conference on.   IEEE, 2014, pp. 343–347.
  17. A. J. O’Toole, P. J. Phillips, F. Jiang, J. Ayyad, N. Penard, and H. Abdi, “Face recognition algorithms surpass humans matching faces over changes in illumination,” IEEE transactions on pattern analysis and machine intelligence, vol. 29, no. 9, 2007.
  18. N. Kumar, A. C. Berg, P. N. Belhumeur, and S. K. Nayar, “Attribute and simile classifiers for face verification,” in Computer Vision, 2009 IEEE 12th International Conference on.   IEEE, 2009, pp. 365–372.
  19. P. J. Phillips and A. J. O’toole, “Comparison of human and computer performance across face recognition experiments,” Image and Vision Computing, vol. 32, no. 1, pp. 74–85, 2014.
  20. A. J. O’Toole, X. An, J. Dunlop, V. Natu, and P. J. Phillips, “Comparing face recognition algorithms to humans on challenging tasks,” ACM Transactions on Applied Perception (TAP), vol. 9, no. 4, p. 16, 2012.
  21. L. Best-Rowden, S. Bisht, J. C. Klontz, and A. K. Jain, “Unconstrained face recognition: Establishing baseline human performance via crowdsourcing,” in Biometrics (IJCB), 2014 IEEE International Joint Conference on.   IEEE, 2014, pp. 1–8.
  22. E. Zhou, Z. Cao, and Q. Yin, “Naive-deep face recognition: Touching the limit of lfw benchmark or not?” arXiv preprint arXiv:1501.04690, 2015.
  23. P. J. Phillips, M. Q. Hill, J. A. Swindle, and A. J. O’Toole, “Human and algorithm performance on the pasc face recognition challenge,” in Biometrics Theory, Applications and Systems (BTAS), 2015 IEEE 7th International Conference on.   IEEE, 2015, pp. 1–8.
  24. A. Blanton, K. C. Allen, T. Miller, N. D. Kalka, and A. K. Jain, “A comparison of human and automated face verification accuracy on unconstrained image sets,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2016, pp. 161–168.
  25. “Iso/iec jtc 1/sc 37 n 506. biometric data interchange formats part 5: Face image data,” 2004.
  26. I. 19794-5, “http://www.correlance.com/cms/en/iso19794-5.”
  27. “Iso/iec tr 29794-5:2010 biometric sample quality – part 5: Face image data (iso/iec tc jtc1/sc 37),” 2010.
  28. Z. Yang, H. Ai, B. Wu, S. Lao, and L. Cai, “Face pose estimation and its application in video shot selection,” in Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on, vol. 1.   IEEE, 2004, pp. 322–325.
  29. X. Gao, S. Z. Li, R. Liu, and P. Zhang, “Standardization of face image sample quality,” in International Conference on Biometrics.   Springer, 2007, pp. 242–251.
  30. K. Nasrollahi and T. B. Moeslund, “Face quality assessment system in video sequences,” in European Workshop on Biometrics and Identity Management.   Springer, 2008, pp. 10–18.
  31. J. Sang, Z. Lei, and S. Z. Li, “Face image quality evaluation for iso/iec standards 19794-5 and 29794-5,” in International Conference on Biometrics.   Springer, 2009, pp. 229–238.
  32. H. Sellahewa and S. A. Jassim, “Image-quality-based adaptive face recognition,” IEEE Transactions on Instrumentation and measurement, vol. 59, no. 4, pp. 805–813, 2010.
  33. Y. Wong, S. Chen, S. Mau, C. Sanderson, and B. C. Lovell, “Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition,” in Computer Vision and Pattern Recognition Workshops (CVPRW), 2011 IEEE Computer Society Conference on.   IEEE, 2011, pp. 74–81.
  34. J. Long and S. Li, “Near infrared face image quality assessment system of video sequences,” in Image and Graphics (ICIG), 2011 Sixth International Conference on.   IEEE, 2011, pp. 275–279.
  35. X.-h. Chen and C.-z. Li, “Image quality assessment model based on features and applications in face recognition,” in Signal Processing, Communications and Computing (ICSPCC), 2011 IEEE International Conference on.   IEEE, 2011, pp. 1–4.
  36. G. Zhang and Y. Wang, “Asymmetry-based quality assessment of face images,” in International Symposium on Visual Computing.   Springer, 2009, pp. 499–508.
  37. S. Bharadwaj, M. Vatsa, and R. Singh, “Can holistic representations be used for face biometric quality assessment?” in Image Processing (ICIP), 2013 20th IEEE International Conference on.   IEEE, 2013, pp. 2792–2796.
  38. R. Raghavendra, K. B. Raja, B. Yang, and C. Busch, “Automatic face quality assessment from video using gray level co-occurrence matrix: An empirical study on automatic border control system,” in Pattern Recognition (ICPR), 2014 22nd International Conference on.   IEEE, 2014, pp. 438–443.
  39. J. Chen, Y. Deng, G. Bai, and G. Su, “Face image quality assessment based on learning to rank,” IEEE signal processing letters, vol. 22, no. 1, pp. 90–94, 2015.
  40. X. Wu, R. He, Z. Sun, and T. Tan, “A light cnn for deep face representation with noisy labels,” arXiv preprint arXiv:1511.02683, 2015.
  41. O. M. Parkhi, A. Vedaldi, and A. Zisserman, “Deep face recognition.” in BMVC, vol. 1, no. 3, 2015, p. 6.
  42. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.
  43. R. M. Bolle, J. H. Connell, S. Pankanti, N. K. Ratha, and A. W. Senior, “The relation between the roc curve and the cmc,” in Automatic Identification Advanced Technologies, 2005. Fourth IEEE Workshop on.   IEEE, 2005, pp. 15–20.
  44. J. Pan, Z. Hu, Z. Su, and M.-H. Yang, “Deblurring face images with exemplars,” in European Conference on Computer Vision.   Springer, 2014, pp. 47–62.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now