Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Joint Person Identity, Gender and Age Estimation from Hand Images using Deep Multi-Task Representation Learning (2303.15263v4)

Published 27 Mar 2023 in cs.CV

Abstract: In this paper, we propose a multi-task representation learning framework to jointly estimate the identity, gender and age of individuals from their hand images for the purpose of criminal investigations since the hand images are often the only available information in cases of serious crime such as sexual abuse. We investigate different up-to-date deep learning architectures and compare their performance for joint estimation of identity, gender and age from hand images of perpetrators of serious crime. To simplify the age prediction, we create age groups for the age estimation. We make extensive evaluations and comparisons of both convolution-based and transformer-based deep learning architectures on a publicly available 11k hands dataset. Our experimental analysis shows that it is possible to efficiently estimate not only identity but also other attributes such as gender and age of suspects jointly from hand images for criminal investigations, which is crucial in assisting international police forces in the court to identify and convict abusers.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (33)
  1. “Biometric recognition using deep learning: A survey,” CoRR, vol. abs/1912.00271, 2019.
  2. “Biometrics: Trust, but verify,” IEEE Transactions on Biometrics, Behavior, and Identity Science, vol. 4, no. 3, pp. 303–323, 2022.
  3. “ArcFace: Additive angular margin loss for deep face recognition,” in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 4685–4694.
  4. Nathanael L. Baisa, “Local-aware global attention network for person re-identification,” CoRR, vol. abs/2209.04821, 2022.
  5. Mahmoud Afifi, “11k hands: gender recognition and biometric identification using a large dataset of hand images,” Multimedia Tools and Applications, 2019.
  6. “Learning a fixed-length fingerprint representation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1–1, 2019.
  7. Z. Zhao and A. Kumar, “Towards more accurate iris recognition using deeply learned spatially corresponding features,” in 2017 IEEE International Conference on Computer Vision (ICCV), 2017, pp. 3829–3838.
  8. “Gait-based person recognition using arbitrary view transformation model,” IEEE Transactions on Image Processing, vol. 24, no. 1, pp. 140–154, 2015.
  9. “Voxceleb2: Deep speaker recognition,” Interspeech 2018, Sep 2018.
  10. “What else does your biometric data reveal? A survey on soft biometrics,” IEEE Transactions on Information Forensics and Security, vol. 11, no. 3, pp. 441–467, 2016.
  11. “A comprehensive overview of biometric fusion,” Information Fusion, vol. 52, pp. 187 – 205, 2019.
  12. “Hand-based person identification using global and part-aware deep feature representation learning,” in 2022 Eleventh International Conference on Image Processing Theory, Tools and Applications (IPTA), 2022, pp. 1–6.
  13. “HandNet: Identification based on hand images using deep learning methods,” in Proceedings of the 2020 4th International Conference on Vision, Image and Signal Processing, New York, NY, USA, 2020, ICVISP 2020, Association for Computing Machinery.
  14. “Feature-level fusion of major and minor dorsal finger knuckle patterns for person authentication,” Signal, Image and Video Processing, Feb. 2021.
  15. “Multi-branch with attention network for hand-based person recognition,” in 2022 26th International Conference on Pattern Recognition (ICPR), 2022.
  16. A. Kumar and Z. Xu, “Personal identification using minor knuckle patterns from palm dorsal surface,” IEEE Transactions on Information Forensics and Security, vol. 11, no. 10, pp. 2338–2348, 2016.
  17. “Robust end-to-end hand identification via holistic multi-unit knuckle recognition,” in 2021 IEEE International Joint Conference on Biometrics (IJCB), 2021, pp. 1–8.
  18. “Automated person identification framework based on fingernails and dorsal knuckle patterns,” in 2021 IEEE Symposium Series on Computational Intelligence (SSCI), 2021, pp. 01–08.
  19. “Automated person identification from hand images using hierarchical vision transformer network,” in 2022 12th International Conference on Computer and Knowledge Engineering (ICCKE), 2022, pp. 398–403.
  20. “Hand image-based human age estimation using a time distributed CNN-GRU,” in 2020 International Conference on Data Analytics for Business and Industry: Way Towards a Sustainable Economy (ICDABI), 2020, pp. 1–5.
  21. “Age and gender prediction from face images using attentional convolutional network,” CoRR, vol. abs/2010.03791, 2020.
  22. “GRA-Net: A deep learning model for classification of age and gender from facial images,” IEEE Access, vol. 9, pp. 85672–85689, 2021.
  23. Hu Han and Anil K. Jain, “Age, gender and race estimation from unconstrained face images,” 2014.
  24. Andrey V. Savchenko, “Efficient facial representations for age, gender and identity recognition in organizing photo albums using multi-output convnet,” PeerJ Comput. Sci., vol. 5, pp. e197, 2019.
  25. “Deep residual learning for image recognition,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 770–778.
  26. “Densely connected convolutional networks,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Los Alamitos, CA, USA, jul 2017, pp. 2261–2269, IEEE Computer Society.
  27. “A convnet for the 2020s,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022, New Orleans, LA, USA, June 18-24, 2022. 2022, pp. 11966–11976, IEEE.
  28. “An image is worth 16x16 words: Transformers for image recognition at scale,” in International Conference on Learning Representations, 2021.
  29. “Swin transformer: Hierarchical vision transformer using shifted windows,” 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 9992–10002, 2021.
  30. “Maxvit: Multi-axis vision transformer,” in Computer Vision – ECCV 2022, Shai Avidan, Gabriel Brostow, Moustapha Cissé, Giovanni Maria Farinella, and Tal Hassner, Eds., Cham, 2022, pp. 459–479, Springer Nature Switzerland.
  31. “Rethinking the inception architecture for computer vision,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 2818–2826.
  32. “A strong baseline and batch normalization neck for deep person re-identification,” IEEE Transactions on Multimedia, vol. 22, no. 10, pp. 2597–2609, 2020.
  33. “Imagenet large scale visual recognition challenge,” CoRR, vol. abs/1409.0575, 2014.
Citations (2)

Summary

We haven't generated a summary for this paper yet.