Human-Centered Autonomy for UAS Target Search (2309.06395v3)
Abstract: Current methods of deploying robots that operate in dynamic, uncertain environments, such as Uncrewed Aerial Systems in search & rescue missions, require nearly continuous human supervision for vehicle guidance and operation. These methods do not consider high-level mission context resulting in cumbersome manual operation or inefficient exhaustive search patterns. We present a human-centered autonomous framework that infers geospatial mission context through dynamic feature sets, which then guides a probabilistic target search planner. Operators provide a set of diverse inputs, including priority definition, spatial semantic information about ad-hoc geographical areas, and reference waypoints, which are probabilistically fused with geographical database information and condensed into a geospatial distribution representing an operator's preferences over an area. An online, POMDP-based planner, optimized for target searching, is augmented with this reward map to generate an operator-constrained policy. Our results, simulated based on input from five professional rescuers, display effective task mental model alignment, 18\% more victim finds, and 15 times more efficient guidance plans then current operational methods.
- Hunter Ray, Ryan Singer and Nisar Ahmed “A Review of the Operational Use of UAS in Public Safety Emergency Incidents” In Proc. of the International Conference on Unmanned Aircraft Systems (ICUAS) Dubrovnik, Croatia: IEEE, 2022, pp. 922–931
- William B. Rouse and Nancy M. Morris “On looking into the black box: Prospects and limits in the search for mental models” In Psychological Bulletin 100, 1986, pp. 349–363
- Aaquib Tabrez, Matthew B. Luebbers and Bradley Hayes “A Survey of Mental Modeling Techniques in Human–Robot Teaming” In Current Robotics Reports 1, 2020, pp. 259–267
- “Toward Genuine Robot Teammates: Improving Human-Robot Team Performance Using Robot Shared Mental Models” In Proc. of the 19th International Conference on Autonomous Agents and Multiagent Systems Auckland, New Zealand: IFAAMAS, 2020, pp. 429–437
- Matthias Scheutz, Scott A. DeLoach and Julie A. Adams “A Framework for Developing and Using Shared Mental Models in Human-Agent Teams” In Journal of Cognitive Engineering and Decision Making 11.3, 2017, pp. 203–224
- Stefano V. Albrecht and Peter Stone “Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problems” In Artificial Intelligence 258, 2018, pp. 66–95
- Stewart Jamieson, Jonathan P. How and Yogesh Girdhar “Active Reward Learning for Co-Robotic Vision Based Exploration in Bandwidth Limited Environments” In 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020, pp. 1806–1812
- Christopher A. Miller “Delegation and intent expression for human-automation interaction” In Proc. of the International Conference on Human-Computer Interaction in Aerospace, HCI-Aero ’14 New York, NY: Association for Computing Machinery, 2014
- “Multi-modal active perception for information gathering in science missions” In Autonomous Robots 43, 2019, pp. 1827–1853
- “A survey of inverse reinforcement learning: Challenges, methods and progress” In Artificial Intelligence 297, 2021, pp. 103500
- “Inverse Reward Design” In Advances in Neural Information Processing Systems 30 Curran Associates, Inc., 2017
- “The Perils of Trial-and-Error Reward Design: Misdesign through Overfitting and Invalid Task Specifications” In Proc. of the 37th AAAI Conference on Artificial Intelligence (AAAI), 2023
- Derek Kingston, Steven Rasmussen and Laura Humphrey “Automated UAV tasks for search and surveillance” In 2016 IEEE Conference on Control Applications (CCA), 2016, pp. 1–8 IEEE
- CB Thomas “US coast guard addendum to the US NSS to the IAMSAR” In United States Coast Guard, Tech. Rep. COMDTINST MI6130 2, 2013
- Frédéric Bourgault, Tomonari Furukawa and Hugh F Durrant-Whyte “Optimal search for a lost target in a bayesian world” In Field and Service Robotics: Recent Advances in Reserch and Applications Springer, 2006, pp. 209–222
- Mykel J Kochenderfer, Tim A Wheeler and Kyle H Wray “Algorithms for decision making” MIT press, 2022
- “Planning search and rescue missions for UAV teams” In Proceedings of the Twenty-second European Conference on Artificial Intelligence, 2016, pp. 1777–1778
- “Multi-resolution POMDP planning for multi-object search in 3D” In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021, pp. 2022–2029 IEEE
- “Multi-object search using object-oriented POMDPs” In 2019 International Conference on Robotics and Automation (ICRA), 2019, pp. 7194–7200 IEEE
- “Online planning for target object search in clutter under partial observability” In 2019 International Conference on Robotics and Automation (ICRA), 2019, pp. 8241–8247 IEEE
- Nisar R. Ahmed, Eric M. Sample and Mark Campbell “Bayesian Multicategorical Soft Data Fusion for Human–Robot Collaboration” In IEEE Transactions on Robotics 29, 2013, pp. 189–206
- “HARPS: An Online POMDP Framework for Human-Assisted Robotic Planning and Sensing” In Press In IEEE Transactions on Robotics, 2022
- “Structured synthesis and compression of semantic human sensor models for Bayesian estimation” In 2016 American Control Conference (ACC) Boston, MA: IEEE, 2016, pp. 5479–5485
- Charles Luke Burks “Active Collaborative Planning and Sensing in Human-Robot Teams”, 2020
- Christopher M. Bishop “Pattern Recognition and Machine Learning” Cambridge U.K.: Springer, 2006
- “Human-Centered Autonomy for UAS Target Search”, 2023 arXiv:2309.06395 [cs.RO]
- “Monte-Carlo planning in large POMDPs” In Advances in neural information processing systems 23, 2010
- “Cumulated gain-based evaluation of IR techniques” In ACM Transactions on Information Systems 20, 2002, pp. 422–446
- “Fully bayesian learning and spatial reasoning with flexible human sensor networks” In Proc. of the ACM/IEEE Sixth International Conference on Cyber-Physical Systems - ICCPS ’15 Seattle, Washington: ACM Press, 2015, pp. 80–89
- “Active Inference for Autonomous Decision-Making with Contextual Multi-Armed Bandits” In 2023 IEEE International Conference on Robotics and Automation, 2023
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.