Enhancing Kinship Verification through Multiscale Retinex and Combined Deep-Shallow features (2312.03562v1)
Abstract: The challenge of kinship verification from facial images represents a cutting-edge and formidable frontier in the realms of pattern recognition and computer vision. This area of study holds a myriad of potential applications, spanning from image annotation and forensic analysis to social media research. Our research stands out by integrating a preprocessing method named Multiscale Retinex (MSR), which elevates image quality and amplifies contrast, ultimately bolstering the end results. Strategically, our methodology capitalizes on the harmonious blend of deep and shallow texture descriptors, merging them proficiently at the score level through the Logistic Regression (LR) method. To elucidate, we employ the Local Phase Quantization (LPQ) descriptor to extract shallow texture characteristics. For deep feature extraction, we turn to the prowess of the VGG16 model, which is pre-trained on a convolutional neural network (CNN). The robustness and efficacy of our method have been put to the test through meticulous experiments on three rigorous kinship datasets, namely: Cornell Kin Face, UB Kin Face, and TS Kin Face.
- S. Atalla, S. Tarapiah, A. Gawanmeh, M. Daradkeh, H. Mukhtar, Y. Himeur, W. Mansoor, K. F. B. Hashim, and M. Daadoo, “Iot-enabled precision agriculture: Developing an ecosystem for optimized crop management,” Information, vol. 14, no. 4, p. 205, 2023.
- Y. Himeur, S. Al-Maadeed, I. Varlamis, N. Al-Maadeed, K. Abualsaud, and A. Mohamed, “Face mask detection in smart cities using deep and transfer learning: lessons learned from the covid-19 pandemic,” Systems, vol. 11, no. 2, p. 107, 2023.
- “3d face recognition based on histograms of local descriptors,” in 2014 4th International Conference on Image Processing Theory, Tools and Applications (IPTA). IEEE, 2014, pp. 1–5.
- I. Serraoui, O. Laiadi, A. Ouamane, F. Dornaika, and A. Taleb-Ahmed, “Knowledge-based tensor subspace analysis system for kinship verification,” Neural Networks, vol. 151, pp. 222–237, 2022.
- Y. Himeur, S. Al-Maadeed, N. Almaadeed, K. Abualsaud, A. Mohamed, T. Khattab, and O. Elharrouss, “Deep visual social distancing monitoring to combat covid-19: A comprehensive survey,” Sustainable cities and society, vol. 85, p. 104064, 2022.
- M. Belahcene, M. Laid, A. Chouchane, A. Ouamane, and S. Bourennane, “Local descriptors and tensor local preserving projection in face recognition,” in 2016 6th European workshop on visual information processing (EUVIP). IEEE, 2016, pp. 1–6.
- X. Wu, X. Feng, X. Cao, X. Xu, D. Hu, M. B. López, and L. Liu, “Facial kinship verification: A comprehensive review and outlook,” International Journal of Computer Vision, vol. 130, no. 6, pp. 1494–1525, 2022.
- S. Xia, M. Shao, and Y. Fu, “Kinship verification through transfer learning,” in Twenty-second international joint conference on artificial intelligence. Citeseer, 2011.
- L. Zhang, Q. Duan, D. Zhang, W. Jia, and X. Wang, “Advkin: Adversarial convolutional network for kinship verification,” IEEE transactions on cybernetics, vol. 51, no. 12, pp. 5883–5896, 2020.
- M. Bessaoudi, M. Belahcene, A. Ouamane, A. Chouchane, and S. Bourennane, “Multilinear enhanced fisher discriminant analysis for robust multimodal 2d and 3d face verification,” Applied Intelligence, vol. 49, pp. 1339–1354, 2019.
- A. Chouchane, A. Ouamane, Y. Himeur, W. Mansoor, S. Atalla, A. Benzaibak, and C. Boudellal, “Improving cnn-based person re-identification using score normalization,” in 2023 IEEE International Conference on Image Processing (ICIP). IEEE, 2023, pp. 2890–2894.
- M. Belahcene, A. Chouchane, and N. Mokhtari, “2d and 3d face recognition based on ipc detection and patch of interest regions,” in 2014 International Conference on Connected Vehicles and Expo (ICCVE). IEEE, 2014, pp. 627–628.
- O. Laiadi, A. Ouamane, A. Benakcha, A. Taleb-Ahmed, and A. Hadid, “Tensor cross-view quadratic discriminant analysis for kinship verification in the wild,” Neurocomputing, vol. 377, pp. 286–300, 2020.
- X. Qin, D. Liu, and D. Wang, “A literature survey on kinship verification through facial images,” Neurocomputing, vol. 377, pp. 213–224, 2020.
- M. Bessaoudi, A. Chouchane, A. Ouamane, and E. Boutellaa, “Multilinear subspace learning using handcrafted and deep features for face kinship verification in the wild,” Applied Intelligence, vol. 51, pp. 3534–3547, 2021.
- R. Fang, K. D. Tang, N. Snavely, and T. Chen, “Towards computational models of kinship verification,” in 2010 IEEE International conference on image processing. IEEE, 2010, pp. 1577–1580.
- S. Xia, M. Shao, J. Luo, and Y. Fu, “Understanding kin relationships in a photo,” IEEE Transactions on Multimedia, vol. 14, no. 4, pp. 1046–1056, 2012.
- X. Zhou, Y. Shang, H. Yan, and G. Guo, “Ensemble similarity learning for kinship verification from facial images in the wild,” Information Fusion, vol. 32, pp. 40–48, 2016.
- J. Lu, X. Zhou, Y.-P. Tan, Y. Shang, and J. Zhou, “Neighborhood repulsed metric learning for kinship verification,” IEEE transactions on pattern analysis and machine intelligence, vol. 36, no. 2, pp. 331–345, 2013.
- H. Yan, “Learning discriminative compact binary face descriptor for kinship verification,” Pattern Recognition Letters, vol. 117, pp. 146–152, 2019.
- H. Yan, J. Lu, and X. Zhou, “Prototype-based discriminative feature learning for kinship verification,” IEEE Transactions on cybernetics, vol. 45, no. 11, pp. 2535–2545, 2014.
- L. Li, X. Feng, X. Wu, Z. Xia, and A. Hadid, “Kinship verification from faces via similarity metric based convolutional neural network,” in Image Analysis and Recognition: 13th International Conference, ICIAR 2016, in Memory of Mohamed Kamel, Póvoa de Varzim, Portugal, July 13-15, 2016, Proceedings 13. Springer, 2016, pp. 539–548.
- K. Zhang12, Y. Huang, C. Song, H. Wu, L. Wang, and S. M. Intelligence, “Kinship verification with deep convolutional neural networks,” in In British Machine Vision Conference (BMVC), 2015.
- M. Bessaoudi, M. Belahcene, A. Ouamane, A. Chouchane, and S. Bourennane, “A novel hybrid approach for 3d face recognition based on higher order tensor,” in Advances in Computing Systems and Applications: Proceedings of the 3rd Conference on Computing Systems and Applications 3. Springer, 2019, pp. 215–224.
- H. Ouamane, “3d face recognition in presence of expressions by fusion regions of interest,” in 2014 22nd Signal Processing and Communications Applications Conference (SIU). IEEE, 2014, pp. 2269–2274.
- A. Chouchane, M. Bessaoudi, H. Kheddar, A. Ouamane, T. Vieira, and M. Hassaballah, “Multilinear subspace learning for person re-identification based fusion of high order tensor features,” Engineering Applications of Artificial Intelligence, 2024. [Online]. Available: http://doi.org/10.1016/j.engappai.2023.107521
- K. Zhang, Z. Zhang, Z. Li, and Y. Qiao, “Joint face detection and alignment using multitask cascaded convolutional networks,” IEEE signal processing letters, vol. 23, no. 10, pp. 1499–1503, 2016.
- Z.-u. Rahman, D. J. Jobson, and G. A. Woodell, “Multi-scale retinex for color image enhancement,” in Proceedings of 3rd IEEE international conference on image processing, vol. 3. IEEE, 1996, pp. 1003–1006.
- K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.
- V. Ojansivu and J. Heikkilä, “Blur insensitive texture classification using local phase quantization,” in Image and Signal Processing: 3rd International Conference, ICISP 2008. Cherbourg-Octeville, France, July 1-3, 2008. Proceedings 3. Springer, 2008, pp. 236–243.
- N. Dehak, P. J. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, “Front-end factor analysis for speaker verification,” IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 4, pp. 788–798, 2010.
- A. Chouchane, M. Belahcene, and S. Bourennane, “3d and 2d face recognition using integral projection curves based depth and intensity images,” International Journal of Intelligent Systems Technologies and Applications, vol. 14, no. 1, pp. 50–69, 2015.
- A. Chouchane, “Analyse d’images d’expressions faciales et orientation de la tête basée sur la profondeur,” Ph.D. dissertation, Université Mohamed Khider-Biskra, 2016.
- E. Belabbaci, M. Khammari, A. Chouchane, A. Ouamane, M. Bessaoudi, Y. Himeur, M. Hassaballah et al., “High-order knowledge-based discriminant features for kinship verification,” Pattern Recognition Letters, 2023.
- X. Qin, X. Tan, and S. Chen, “Tri-subject kinship verification: Understanding the core of a family,” IEEE Transactions on Multimedia, vol. 17, no. 10, pp. 1855–1867, 2015.
- A. Goyal and T. Meenpal, “Eccentricity based kinship verification from facial images in the wild,” Pattern Analysis and Applications, vol. 24, pp. 119–144, 2021.
- M. Mukherjee and T. Meenpal, “Binary cross coupled discriminant analysis for visual kinship verification,” Signal Processing: Image Communication, vol. 108, p. 116829, 2022.
- A. Goyal and T. Meenpal, “Kinship verification using multi-level dictionary pair learning for multiple resolution images,” Pattern Recognition, p. 109742, 2023.