Qualitative Prediction of Multi-Agent Spatial Interactions (2307.00065v1)
Abstract: Deploying service robots in our daily life, whether in restaurants, warehouses or hospitals, calls for the need to reason on the interactions happening in dense and dynamic scenes. In this paper, we present and benchmark three new approaches to model and predict multi-agent interactions in dense scenes, including the use of an intuitive qualitative representation. The proposed solutions take into account static and dynamic context to predict individual interactions. They exploit an input- and a temporal-attention mechanism, and are tested on medium and long-term time horizons. The first two approaches integrate different relations from the so-called Qualitative Trajectory Calculus (QTC) within a state-of-the-art deep neural network to create a symbol-driven neural architecture for predicting spatial interactions. The third approach implements a purely data-driven network for motion prediction, the output of which is post-processed to predict QTC spatial interactions. Experimental results on a popular robot dataset of challenging crowded scenarios show that the purely data-driven prediction approach generally outperforms the other two. The three approaches were further evaluated on a different but related human scenarios to assess their generalisation capability.
- M. Delafontaine, S. H. Chavoshi, A. G. Cohn, and N. Van de Weghe, “A qualitative trajectory calculus to reason about moving point objects,” in Qualitative spatio-temporal representation and reasoning: Trends and future directions. IGI Global, 2012.
- N. Bellotto, “Robot control based on qualitative representation of human trajectories,” in 2012 AAAI Spring Symposium Series, 2012.
- M. Hanheide, A. Peters, and N. Bellotto, “Analysis of human-robot spatial behaviour applying a qualitative trajectory calculus,” in 2012 IEEE Int. Symposium on Robot and Human Interactive Communication. IEEE, 2012.
- C. Dondrup, N. Bellotto, and M. Hanheide, “A probabilistic model of human-robot spatial interaction using a qualitative trajectory calculus,” in 2014 AAAI Spring Symposium Series, 2014.
- N. Bellotto, M. Hanheide, and N. Van de Weghe, “Qualitative design and implementation of human-robot spatial interactions,” in Int. Conf. on Social Robotics. Springer, 2013.
- C. Dondrup and M. Hanheide, “Qualitative constraints for human-aware robot navigation using velocity costmaps,” in 2016 25th IEEE Int. Symposium on Robot and Human Interactive Communication. IEEE, 2016.
- C. Chen, Y. Liu, S. Kreiss, and A. Alahi, “Crowd-robot interaction: Crowd-aware robot navigation with attention-based deep reinforcement learning,” in 2019 Int. Conf. on Robotics and Automation. IEEE, 2019.
- A. Pokle, R. Martín-Martín, P. Goebel, V. Chow, H. M. Ewald, J. Yang, Z. Wang, A. Sadeghian, D. Sadigh, S. Savarese, et al., “Deep local trajectory replanning and control for robot navigation,” in 2019 Int. Conf. on Robotics and Automation. IEEE, 2019.
- K. Ijaz, S. Sohail, and S. Hashish, “A survey of latest approaches for crowd simulation and modeling using hybrid techniques,” in Proceedings of the 2015 17th UKSIM-AMSS Int. Conf. on Modelling and Simulation. IEEE Computer Society, 2015.
- H. Hedayati, A. Muehlbradt, D. J. Szafir, and S. Andrist, “Reform: Recognizing f-formations for social robots,” in 2020 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2020.
- A. Alahi, K. Goel, V. Ramanathan, A. Robicquet, L. Fei-Fei, and S. Savarese, “Social lstm: Human trajectory prediction in crowded spaces,” in Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition, 2016.
- A. Gupta, J. Johnson, L. Fei-Fei, S. Savarese, and A. Alahi, “Social gan: Socially acceptable trajectories with generative adversarial networks,” in the IEEE conf. on computer vision and pattern recognition, 2018.
- Y. Huang, H. Bi, Z. Li, T. Mao, and Z. Wang, “Stgat: Modeling spatial-temporal interactions for human trajectory prediction,” in the IEEE/CVF Int. conf. on computer vision, 2019.
- C. Tao, Q. Jiang, L. Duan, and P. Luo, “Dynamic and static context-aware lstm for multi-agent motion prediction,” in European Conf. on Computer Vision. Springer, 2020.
- J. Liang, L. Jiang, J. C. Niebles, A. G. Hauptmann, and L. Fei-Fei, “Peeking into the future: Predicting future person activities and locations in videos,” in the IEEE/CVF conf. on computer vision and pattern recognition, 2019.
- J. Manzo, “Machines, people, and social interaction in “third-wave” coffeehouses,” Journal of Arts and Humanities, 2014.
- Y. Qin, D. Song, H. Cheng, W. Cheng, G. Jiang, and G. W. Cottrell, “A dual-stage attention-based recurrent neural network for time series prediction,” in the 26th Int. Joint Conf. on Artificial Intelligence. AAAI Press, 2017.
- E. T. Hall and T. Edward, “Hall. the hidden dimension,” Anchor Books New York, 1969.