Neural Interaction Energy for Multi-Agent Trajectory Prediction (2404.16579v1)
Abstract: Maintaining temporal stability is crucial in multi-agent trajectory prediction. Insufficient regularization to uphold this stability often results in fluctuations in kinematic states, leading to inconsistent predictions and the amplification of errors. In this study, we introduce a framework called Multi-Agent Trajectory prediction via neural interaction Energy (MATE). This framework assesses the interactive motion of agents by employing neural interaction energy, which captures the dynamics of interactions and illustrates their influence on the future trajectories of agents. To bolster temporal stability, we introduce two constraints: inter-agent interaction constraint and intra-agent motion constraint. These constraints work together to ensure temporal stability at both the system and agent levels, effectively mitigating prediction fluctuations inherent in multi-agent systems. Comparative evaluations against previous methods on four diverse datasets highlight the superior prediction accuracy and generalization capabilities of our model.
- Social lstm: Human trajectory prediction in crowded spaces. In CVPR.
- Spectral temporal graph neural network for multivariate time-series forecasting. In NeurIPS.
- Crowd-robot interaction: Crowd-aware robot navigation with attention-based deep reinforcement learning. In ICRA.
- Neural ordinary differential equations. In NeurIPS.
- Stability of multi-agent systems. In SMC’03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme-System Security and Assurance.
- Nachiket Deo and Mohan M Trivedi. 2018. Convolutional social pooling for vehicle trajectory prediction. In CVPR Workshops.
- Symplectic ODE-Net: Learning Hamiltonian Dynamics with Control. In ICLR.
- Semi-Supervised Generative Models for Multiagent Trajectories. In NeurIPS.
- Loki: Long term and key intentions for trajectory prediction. In CVPR.
- Transformer networks for trajectory forecasting. In ICPR.
- Colin Graber and Alexander Schwing. 2020. Dynamic neural relational inference for forecasting trajectories. In CVPR Workshops.
- Social gan: Socially acceptable trajectories with generative adversarial networks. In CVPR.
- Multi-Modal Trajectory Prediction of NBA Players. In CVPR.
- Dirk Helbing and Peter Molnar. 1995. Social force model for pedestrian dynamics. Physical review E 51, 5 (1995), 4282.
- beta-VAE: Learning basic visual concepts with a constrained variational framework. In ICLR.
- STGAT: Modeling spatial-temporal interactions for human trajectory prediction. In ICCV.
- Multi-agent trajectory prediction with fuzzy query attention. In NeurIPS.
- Development and evaluation of an interactive humanoid robot” Robovie”. In ICRA.
- Universal power law governing pedestrian interactions. Physical review letters 113, 23 (2014), 238701.
- Physics-informed machine learning. Nature Reviews Physics 3, 6 (2021), 422–440.
- Diederik P Kingma and Max Welling. 2014. Auto-encoding variational bayes. In ICLR.
- Neural Relational Inference for Interacting Systems. In ICML.
- Towards fully autonomous driving: Systems and algorithms. In IV.
- Evolvegraph: Multi-agent trajectory prediction with dynamic relational reasoning. In NeurIPS.
- GRIN Generative Relation and Intention Network for Multi-agent Trajectory Prediction. In NeurIPS.
- Physics-informed neural operator for learning partial differential equations. arXiv preprint arXiv:2111.03794 (2021).
- Huynh Manh and Gita Alaghband. 2018. Scene-lstm: A model for human trajectory prediction. arXiv preprint arXiv:1808.04018 (2018).
- Leapfrog Diffusion Model for Stochastic Trajectory Prediction. In CVPR.
- Social-stgcnn: A social spatio-temporal graph convolutional neural network for human trajectory prediction. In CVPR.
- PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception. In AAAI.
- Automatic differentiation in pytorch. In NeurIPS.
- Experiment-based modeling, simulation and validation of interactions between virtual walkers. In Proceedings of the 2009 ACM SIGGRAPH/Eurographics symposium on computer animation.
- Holistic LSTM for pedestrian trajectory prediction. IEEE transactions on image processing 30 (2021), 3229–3239.
- Machine theory of mind. In ICML.
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics 378 (2019), 686–707.
- Learning to simulate complex physics with graph networks. In ICML.
- On the impact of larger batch size in the training of Physics Informed Neural Networks. In NeurIPS Workshop.
- Learning structured output representation using deep conditional generative models. In NeurIPS.
- Interaction modeling with multiplex attention. In NeurIPS.
- Relational Forward Models for Multi-Agent Learning. In ICLR.
- Collaborative uncertainty benefits multi-agent multi-modal trajectory forecasting. IEEE Transactions on Pattern Analysis and Machine Intelligence (2023).
- Reciprocal n-body collision avoidance. In Robotics Research: The 14th International Symposium ISRR.
- Graph attention networks. In ICLR.
- Social attention: Modeling attention in human crowds. In ICRA.
- Factorised neural relational inference for multi-interaction systems. In ICML Workshops.
- Human trajectory prediction via neural social physics. In ECCV.
- Generating multi-agent trajectories using programmatic weak supervision. In ICLR.
- Multi-agent tensor fusion for contextual trajectory prediction. In CVPR.
- Neuralpde: Automating physics-informed neural networks (pinns) with error approximations. arXiv preprint arXiv:2107.09443 (2021).