Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

VRBiom: A New Periocular Dataset for Biometric Applications of HMD (2407.02150v1)

Published 2 Jul 2024 in cs.CV

Abstract: With advancements in hardware, high-quality HMD devices are being developed by numerous companies, driving increased consumer interest in AR, VR, and MR applications. In this work, we present a new dataset, called VRBiom, of periocular videos acquired using a Virtual Reality headset. The VRBiom, targeted at biometric applications, consists of 900 short videos acquired from 25 individuals recorded in the NIR spectrum. These 10s long videos have been captured using the internal tracking cameras of Meta Quest Pro at 72 FPS. To encompass real-world variations, the dataset includes recordings under three gaze conditions: steady, moving, and partially closed eyes. We have also ensured an equal split of recordings without and with glasses to facilitate the analysis of eye-wear. These videos, characterized by non-frontal views of the eye and relatively low spatial resolutions (400 x 400), can be instrumental in advancing state-of-the-art research across various biometric applications. The VRBiom dataset can be utilized to evaluate, train, or adapt models for biometric use-cases such as iris and/or periocular recognition and associated sub-tasks such as detection and semantic segmentation. In addition to data from real individuals, we have included around 1100 PA constructed from 92 PA instruments. These PAIs fall into six categories constructed through combinations of print attacks (real and synthetic identities), fake 3D eyeballs, plastic eyes, and various types of masks and mannequins. These PA videos, combined with genuine (bona-fide) data, can be utilized to address concerns related to spoofing, which is a significant threat if these devices are to be used for authentication. The VRBiom dataset is publicly available for research purposes related to biometric applications only.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (45)
  1. “A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda,” Computers & education, vol. 147, pp. 103778, 2020.
  2. Dorota Kamińska et al., “Virtual reality and its applications in education: Survey,” Information, vol. 10, no. 10, pp. 318, 2019.
  3. Biao Xie et al., “A review on virtual reality skill training applications,” Frontiers in Virtual Reality, vol. 2, pp. 645153, 2021.
  4. “Augmented reality in vocational training: A systematic review of research and applications,” Computers in Human Behavior, vol. 129, pp. 107125, 2022.
  5. Andy Wai Kan Yeung et al., “Virtual and augmented reality applications in medicine: analysis of the scientific literature,” Journal of medical internet research, vol. 23, no. 2, pp. e25499, 2021.
  6. “Virtual reality applications toward medical field,” Clinical Epidemiology and Global Health, vol. 8, no. 2, pp. 600–605, 2020.
  7. “Current perspective of metaverse application in medical education, research and patient care,” in Virtual Worlds. MDPI, 2023, vol. 2, pp. 115–128.
  8. “Iris and periocular biometrics for head mounted displays: Segmentation, recognition, and synthetic data generation,” Image and Vision Computing, vol. 104, pp. 104007, 2020.
  9. “On benchmarking iris recognition within a head-mounted display for ar/vr applications,” in Proceedings of the IEEE International Joint Conference on Biometrics (IJCB). IEEE, 2020, pp. 1–10.
  10. “Introduction to iris presentation attack detection,” Handbook of Biometric Anti-Spoofing: Presentation Attack Detection, pp. 135–150, 2019.
  11. “Presentation attack detection for iris recognition: An assessment of the state-of-the-art,” ACM Computing Surveys (CSUR), vol. 51, no. 4, pp. 1–35, 2018.
  12. “Edge-guided near-eye image analysis for head mounted displays,” in Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 2021, pp. 11–20.
  13. “Eye tracking in virtual reality,” Journal of eye movement research, vol. 12, no. 1, 2019.
  14. “ARETT: augmented reality eye tracking toolkit for head mounted displays,” Sensors, vol. 21, no. 6, pp. 2234, 2021.
  15. Efe Bozkir et al., “Eye-tracked virtual reality: A comprehensive survey on methods and privacy challenges,” arXiv preprint arXiv:2305.14080, 2023.
  16. “Periocular biometrics in head-mounted displays: A sample selection approach for better recognition,” in International Workshop on Biometrics and Forensics (IWBF), 2020, pp. 1–6.
  17. Caiyong Wang et al., “Nir iris challenge evaluation in non-cooperative environments: Segmentation and localization,” in 2021 IEEE International joint conference on biometrics (IJCB). IEEE, 2021, pp. 1–10.
  18. “Iris + Ocular: Generalized iris presentation attack detection using multiple convolutional neural networks,” in International Conference on Biometrics (ICB). IEEE, 2019, pp. 1–8.
  19. Chinese Academy of Sciences, “Casia iris image database,” 2002, http://biometrics.idealtest.org.
  20. “Ocular recognition databases and competitions: A survey,” Artificial Intelligence Review, vol. 55, no. 1, pp. 129–180, 2022.
  21. “A survey of iris datasets,” Image and Vision Computing, vol. 108, pp. 104109, 2021.
  22. David Yambay et al., “Livdet iris 2017–iris liveness detection competition 2017,” in IEEE International Joint Conference on Biometrics (IJCB). IEEE, 2017, pp. 733–741.
  23. Patrick Tinsley et al., “Iris liveness detection competition (livdet-iris)–the 2023 edition,” in IEEE International Joint Conference on Biometrics (IJCB). IEEE, 2023, pp. 1–10.
  24. “Ubiris: A noisy iris image database,” in International Conference on Image Analysis and Processing (ICIAP). Springer, 2005, pp. 970–977.
  25. “The ubiris. v2: A database of visible wavelength iris images captured on-the-move and at-a-distance,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 8, pp. 1529–1535, 2009.
  26. “A robust iris segmentation with fuzzy supports,” in International Conference on Neural Information Processing (ICONIP). Springer, 2010, pp. 532–539.
  27. “Deep learning for iris recognition: A survey,” ACM Computing Surveys, vol. 56, no. 9, pp. 1–35, 2024.
  28. “A dataset for point of gaze detection using head poses and eye images,” Journal on Multimodal User Interfaces, vol. 7, pp. 207–215, 2013.
  29. “Labelled pupils in the wild: a dataset for studying pupil detection in unconstrained environments,” in Proceedings of the ninth biennial ACM symposium on eye tracking research & applications, 2016, pp. 139–142.
  30. Joohwan Kim et al., “Nvgaze: An anatomically-informed dataset for low-latency, near-eye gaze estimation,” in Proceedings of the CHI conference on human factors in computing systems, 2019, pp. 1–12.
  31. “Openeds: Open eye dataset,” arXiv preprint arXiv:1905.03702, 2019.
  32. “Openeds2020: Open eyes dataset,” arXiv preprint arXiv:2005.03876, 2020.
  33. Handbook of iris recognition, Springer, 2016.
  34. “Deep learning for iris recognition: a review,” arXiv preprint arXiv:2303.08514, 2023.
  35. “A survey on periocular biometrics research,” Pattern Recognition Letters, vol. 82, pp. 92–105, 2016.
  36. Man Zhang et al., “The first ICB* competition on iris recognition,” in IEEE International Joint Conference on Biometrics. IEEE, 2014, pp. 1–6.
  37. “The btas competition on mobile iris recognition,” in 8th international conference on biometrics theory, applications and systems (BTAS). IEEE, 2016, pp. 1–7.
  38. “Iris presentation attack detection: Where are we now?,” Pattern Recognition Letters, vol. 138, pp. 483–489, 2020.
  39. “Presentation attack detection using a generalizable statistical approach for periocular and iris systems,” in Proceedings of the International Conference of the Biometrics Special Interest Group (BIOSIG), 2016, pp. 1–6.
  40. “Iris segmentation: a survey,” International Journal of Modern Engineering Research (IJMER), vol. 3, no. 4, pp. 1885–1889, 2013.
  41. “Deep sclera segmentation and recognition,” Handbook of vascular biometrics, pp. 395–432, 2020.
  42. “Ritnet: Real-time semantic segmentation of the eye for gaze tracking,” in IEEE/CVF International Conference on Computer Vision Workshop (ICCVW). IEEE, 2019, pp. 3698–3702.
  43. “Minenet: A dilated cnn for semantic segmentation of eye features,” in Proceedings of the IEEE/CVF international conference on computer vision workshops, 2019, pp. 0–0.
  44. “Towards an efficient segmentation algorithm for near-infrared eyes images,” IEEE Access, vol. 8, pp. 171598–171607, 2020.
  45. Abhijit Das et al., “Sclera segmentation and joint recognition benchmarking competition: Ssrbc 2023,” in IEEE International Joint Conference on Biometrics (IJCB). IEEE, 2023, pp. 1–10.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Ketan Kotwal (9 papers)
  2. Ibrahim Ulucan (1 paper)
  3. Janani Selliah (1 paper)
  4. Sebastien Marcel (77 papers)
  5. Gokhan Ozbulak (1 paper)
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now