Data-Driven Goal Recognition Design for General Behavioral Agents (2404.03054v2)
Abstract: Goal recognition design aims to make limited modifications to decision-making environments with the goal of making it easier to infer the goals of agents acting within those environments. Although various research efforts have been made in goal recognition design, existing approaches are computationally demanding and often assume that agents are (near-)optimal in their decision-making. To address these limitations, we introduce a data-driven approach to goal recognition design that can account for agents with general behavioral models. Following existing literature, we use worst-case distinctiveness($\textit{wcd}$) as a measure of the difficulty in inferring the goal of an agent in a decision-making environment. Our approach begins by training a machine learning model to predict the $\textit{wcd}$ for a given environment and the agent behavior model. We then propose a gradient-based optimization framework that accommodates various constraints to optimize decision-making environments for enhanced goal recognition. Through extensive simulations, we demonstrate that our approach outperforms existing methods in reducing $\textit{wcd}$ and enhancing runtime efficiency in conventional setup. Moreover, our approach also adapts to settings in which existing approaches do not apply, such as those involving flexible budget constraints, more complex environments, and suboptimal agent behavior. Finally, we have conducted human-subject experiments which confirm that our method can create environments that facilitate efficient goal recognition from real-world human decision-makers.
- Is the most accurate ai the best teammate? optimizing ai for teamwork. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, 2021.
- On the utility of learning about humans for human-ai coordination. Advances in neural information processing systems, 2019.
- Neural payoff machines: Predicting fair and stable payoff allocations among team members. In Advances in Neural Information Processing Systems, 2022.
- Certifying strategyproof auction networks. In Advances in Neural Information Processing Systems, 2020.
- Optimal auctions through deep learning. In International Conference on Machine Learning, 2019.
- Deep learning for revenue-optimal auctions with budgets. In Proceedings of the 17th International Conference on Autonomous Agents and Multiagent Systems, 2018.
- Deep learning for multi-facility location mechanism design. In Proceedings of the International Joint Conference on Artificial Intelligence, 2018.
- Jun Hong. Goal recognition through goal graph analysis. Journal of Artificial Intelligence Research, 15, 2001.
- Daniel Kahneman. A perspective on judgment and choice: mapping bounded rationality. American Psychologist, 58(9):697, 2003.
- Henry A Kautz et al. A formal theory of plan recognition and its implementation. Reasoning about plans, 1991.
- Goal recognition design. In Proceedings of the International Conference on Automated Planning and Scheduling, 2014.
- Goal recognition design for non-optimal agents. In Proceedings of the AAAI Conference on Artificial Intelligence, 2015.
- Goal recognition design with non-observable actions. In Proceedings of the AAAI Conference on Artificial Intelligence, 2016.
- Goal recognition design-survey. In Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence, 2021.
- Proportionnet: Balancing fairness and revenue for auction design with deep learning. arXiv preprint arXiv:2010.06398, 2020.
- Extended goal recognition: a planning-based model for strategic deception. In Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems, 2021.
- Goal and plan recognition design for plan libraries. ACM Transactions on Intelligent Systems and Technology (TIST), 10(2), 2019.
- Doing it now or later. American Economic Review, 89(1), 1999.
- Landmark-based heuristics for goal recognition. In Proceedings of the AAAI Conference on Artificial Intelligence, 2017.
- Preferencenet: Encoding human preferences in auction design with deep learning. Advances in Neural Information Processing Systems, 2021.
- Auction learning as a two-player game. In International Conference on Learning Representations, 2020.
- Probabilistic plan recognition using off-the-shelf classical planners. In Proceedings of the AAAI conference on artificial intelligence, 2010.
- Plan, activity, and intent recognition: Theory and practice. Newnes, 2014.
- Stochastic goal recognition design problems with suboptimal agents. In Proceedings of the AAAI Conference on Artificial Intelligence, 2022.
- Goal recognition design with stochastic agent action outcomes. In Proceedings of the International Joint Conference on Artificial Intelligence, 2016.
- New metrics and algorithms for stochastic goal recognition design problems. In Proceedings of the International Joint Conference on Artificial Intelligence, 2017.
- Accounting for observer’s partial observability in stochastic goal recognition design. In Proceedings of the European Conference on Artificial Intelligence, 2020.
- Environment design for biased decision makers. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), 2022.
- Encoding human behavior in information design through deep learning. In Thirty-seventh Conference on Neural Information Processing Systems, 2023.