Face Image Quality Enhancement Study for Face Recognition (2307.05534v1)
Abstract: Unconstrained face recognition is an active research area among computer vision and biometric researchers for many years now. Still the problem of face recognition in low quality photos has not been well-studied so far. In this paper, we explore the face recognition performance on low quality photos, and we try to improve the accuracy in dealing with low quality face images. We assemble a large database with low quality photos, and examine the performance of face recognition algorithms for three different quality sets. Using state-of-the-art facial image enhancement approaches, we explore the face recognition performance for the enhanced face images. To perform this without experimental bias, we have developed a new protocol for recognition with low quality face photos and validate the performance experimentally. Our designed protocol for face recognition with low quality face images can be useful to other researchers. Moreover, experiment results show some of the challenging aspects of this problem.
- E. Bilgazyev, B. Efraty, S. K. Shah, and I. A. Kakadiaris, “Improved face recognition using super-resolution,” in 2011 International Joint Conference on Biometrics (IJCB), Oct 2011, pp. 1–7.
- R. Dahl, M. Norouzi, and J. Shlens, “Pixel Recursive Super Resolution,” ArXiv e-prints, Feb. 2017.
- R. Huang, S. Zhang, T. Li, and R. He, “Beyond Face Rotation: Global and Local Perception GAN for Photorealistic and Identity Preserving Frontal View Synthesis,” ArXiv e-prints, Apr. 2017.
- C. Ferrari, G. Lisanti, S. Berretti, and A. D. Bimbo, “Effective 3d based frontalization for unconstrained face recognition,” in 2016 23rd International Conference on Pattern Recognition (ICPR), Dec 2016, pp. 1047–1052.
- T. Hassner, S. Harel, E. Paz, and R. Enbar, “Effective face frontalization in unconstrained images,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015.
- C. Sagonas, Y. Panagakis, S. Zafeiriou, and M. Pantic, “Robust statistical face frontalization,” in 2015 IEEE International Conference on Computer Vision (ICCV), Dec 2015, pp. 3871–3879.
- E. Hait and G. Gilboa, “Blind Facial Image Quality Enhancement Using Non-Rigid Semantic Patches,” IEEE Transactions on Image Processing, vol. 26, pp. 2705–2720, Jun. 2017.
- B. F. Klare, B. Klein, E. Taborsky, A. Blanton, J. Cheney, K. Allen, P. Grother, A. Mah, M. Burge, and A. K. Jain, “Pushing the frontiers of unconstrained face detection and recognition: Iarpa janus benchmark a,” in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015, pp. 1931–1939.
- J. Chen, Y. Deng, G. Bai, and G. Su, “Face image quality assessment based on learning to rank,” IEEE Signal Processing Letters, vol. 22, no. 1, pp. 90–94, Jan 2015.
- T. Baltrušaitis, P. Robinson, and L. P. Morency, “Openface: An open source facial behavior analysis toolkit,” in WACV, March 2016, pp. 1–10.
- T. Baltrusaitis, P. Robinson, and L. P. Morency, “Constrained local neural fields for robust facial landmark detection in the wild,” in ICCVW, Dec 2013, pp. 354–361.
- S. Banerjee, J. Brogan, J. Krizaj, A. Bharati, B. RichardWebster, V. Struc, P. Flynn, and W. Scheirer, “To Frontalize or Not To Frontalize: Do We Really Need Elaborate Pre-Processing to Improve Face Recognition Performance?” ArXiv e-prints, Oct. 2016.
- J. Pan, Z. Hu, Z. Su, and M.-H. Yang, “Deblurring face images with exemplars,” in European Conference on Computer Vision. Springer, 2014, pp. 47–62.
- N. Nill and B. Bouzas, “Objective image quality measure derived from digital image power spectra.” Optical Engineering, vol. 31, no. 4, pp. 813–825,, 1992.
- B. Wang, W. Li, W. Yang, and Q. Liao, “Illumination normalization based on weber’s law with application to face recognition,” IEEE Signal Processing Letters, vol. 18, no. 8, pp. 462–465, Aug 2011.
- O. M. Parkhi, A. Vedaldi, and A. Zisserman, “Deep face recognition.” in BMVC, vol. 1, no. 3, 2015, p. 6.
- X. Wu, R. He, and Z. Sun, “A lightened cnn for deep face representation,” arXiv preprint arXiv:1511.02683, 2015.
- Y. Wen, K. Zhang, Z. Li, and Y. Qiao, “A discriminative feature learning approach for deep face recognition,” in European Conference on Computer Vision. Springer, 2016, pp. 499–515.
- F. Schroff, D. Kalenichenko, and J. Philbin, “Facenet: A unified embedding for face recognition and clustering,” in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015, pp. 815–823.