Diver Identification Using Anthropometric Data Ratios for Underwater Multi-Human-Robot Collaboration (2310.00146v1)
Abstract: Recent advances in efficient design, perception algorithms, and computing hardware have made it possible to create improved human-robot interaction (HRI) capabilities for autonomous underwater vehicles (AUVs). To conduct secure missions as underwater human-robot teams, AUVs require the ability to accurately identify divers. However, this remains an open problem due to divers' challenging visual features, mainly caused by similar-looking scuba gear. In this paper, we present a novel algorithm that can perform diver identification using either pre-trained models or models trained during deployment. We exploit anthropometric data obtained from diver pose estimates to generate robust features that are invariant to changes in distance and photometric conditions. We also propose an embedding network that maximizes inter-class distances in the feature space and minimizes those for the intra-class features, which significantly improves classification performance. Furthermore, we present an end-to-end diver identification framework that operates on an AUV and evaluate the accuracy of the proposed algorithm. Quantitative results in controlled-water experiments show that our algorithm achieves a high level of accuracy in diver identification.
- Environmental Monitoring using Autonomous Vehicles: A Survey of Recent Searching Techniques. Current Opinion in Biotechnology, 45:76–84, 2017.
- Toward a Generic Diver-Following Algorithm: Balancing Robustness and Efficiency in Deep Visual Detection. IEEE Robotics and Automation Letters, 4(1):113–120, 2019.
- Robotic Tools for Deep Water Archaeology: Surveying an Ancient Shipwreck with an Autonomous Underwater Vehicle. Journal of Field Robotics (JFR), 27(6):702–717, 2010.
- Fourier Tags: Smoothly Degradable Fiducial Markers for Use in Human-Robot Interaction. In Fourth Canadian Conference on Computer and Robot Vision (CRV ’07), pages 165–174, 2007.
- Dynamic Reconfiguration of Mission Parameters in Underwater Human-Robot Collaboration. In 2018 IEEE International Conference on Robotics and Automation (ICRA), pages 6212–6219. IEEE, 2018.
- Human-Robot Interaction Underwater: Communication and Safety Requirements. In 2016 IEEE Third Underwater Communications and Networking Conference (UComms), pages 1–5. IEEE, 2016.
- Visual Diver Face Recognition for Underwater Human-Robot Interaction. arXiv preprint arXiv:2011.09556, 2020.
- Alphonse Bertillon. Signaletic Instructions, including the Theory and Practice of Anthropometrical Identification. Nature, pages 569–570, October 1896.
- Computational Workload in Biometric Identification Systems: An Overview. IET Biometrics, 8(6):351–368, 2019.
- Affective EEG-Based Person Identification Using the Deep Learning Approach. IEEE Transactions on Cognitive and Developmental Systems, 12(3):486–496, 2020.
- Face Recognition Systems: A Survey. Sensors, 20(2):342, 2020.
- ArcFace: Additive Angular Margin Loss for Deep Face Recognition. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 4685–4694, 2019.
- Wider Face: A Face Detection Benchmark. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 5525–5533, 2016.
- MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part III 14, pages 87–102. Springer, 2016.
- DigiFace-1M: 1 Million Digital Face Images for Face Recognition. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 3526–3535, 2023.
- Deep learning, volume 1. MIT press Cambridge, MA, USA, 2017.
- Vision-based Approaches Towards Person Identification using Gait. Computer Science Review, 42:100432, 2021.
- Visual Diver Recognition for Underwater Human-Robot Collaboration. In 2019 International Conference on Robotics and Automation (ICRA), pages 6839–6845. IEEE, 2019.
- Real-Time Multi-Diver Tracking and Re-identification for Underwater Human-Robot Collaboration. In 2020 IEEE International Conference on Robotics and Automation (ICRA), pages 11140–11146. IEEE, 2020.
- Person Identification Using Full-Body Motion and Anthropometric Biometrics From Kinect Videos. In Computer Vision–ECCV 2012. Workshops and Demonstrations: Florence, Italy, October 7-13, 2012, Proceedings, Part III 12, pages 91–100. Springer, 2012.
- Person Identification Using Anthropometric and Gait Data from Kinect Sensor. Proceedings of the AAAI Conference on Artificial Intelligence, 29(1), Feb. 2015.
- Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2017.
- NVIDIA AI IOT. trt_pose. https://github.com/NVIDIA-AI-IOT/trt_pose, 2019.
- MediaPipe: A Framework for Building Perception Pipelines. arXiv preprint arXiv:1906.08172, 2019.
- DeepLabCut: Markerless Pose Estimation of User-defined Body Parts with Deep Learning. Nature Neuroscience, 21(9):1281–1289, 2018.
- Deep High-Resolution Representation Learning for Visual Recognition. IEEE transactions on pattern analysis and machine intelligence, 43(10):3349–3364, 2020.
- Anthropometric Survey of US Army Personnel: Summary Statistics, Interim Report for 1988. Technical report, Anthropology Research Project Inc Yellow Springs OH, 1989.
- Distance Metric Learning: A Comprehensive Survey. Michigan State University, 2(2):4, 2006.
- Leif E Peterson. K-Nearest Neighbor. Scholarpedia, 4(2):1883, 2009.
- William S Noble. What Is a Support Vector Machine? Nature Biotechnology, 24(12):1565–1567, 2006.
- FaceNet: A Unified Embedding for Face Recognition and Clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 815–823, 2015.
- Laurens Van der Maaten and Geoffrey Hinton. Visualizing Data using t-SNE. Journal of machine learning research, 9(11), 2008.
- ROS: An Open-Source Robot Operating System. In ICRA workshop on open source software, volume 3, page 5. Kobe, Japan, 2009.
- Using Monocular Vision and Human Body Priors for AUVs to Autonomously Approach Divers. In 2022 International Conference on Robotics and Automation (ICRA), pages 1076–1082, 2022.
- Norman S Nise. Control systems engineering. John Wiley & Sons, 2020.
- Scikit-learn: Machine Learning in Python. The Journal of Machine Learning Research, 12:2825–2830, 2011.
- PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems, pages 8024–8035. Curran Associates, Inc., 2019.
- Sebastian Ruder. An overview of gradient descent optimization algorithms. arXiv preprint arXiv:1609.04747, 2016.
- Design and Experiments with LoCO AUV: A Low Cost Open-Source Autonomous Underwater Vehicle*. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 1761–1768, 2020.