Uncovering the human motion pattern: Pattern Memory-based Diffusion Model for Trajectory Prediction (2401.02916v2)
Abstract: Human trajectory forecasting is a critical challenge in fields such as robotics and autonomous driving. Due to the inherent uncertainty of human actions and intentions in real-world scenarios, various unexpected occurrences may arise. To uncover latent motion patterns in human behavior, we introduce a novel memory-based method, named Motion Pattern Priors Memory Network. Our method involves constructing a memory bank derived from clustered prior knowledge of motion patterns observed in the training set trajectories. We introduce an addressing mechanism to retrieve the matched pattern and the potential target distributions for each prediction from the memory bank, which enables the identification and retrieval of natural motion patterns exhibited by agents, subsequently using the target priors memory token to guide the diffusion model to generate predictions. Extensive experiments validate the effectiveness of our approach, achieving state-of-the-art trajectory prediction accuracy. The code will be made publicly available.
- “Towards fully autonomous driving: Systems and algorithms,” in 2011 IEEE intelligent vehicles symposium (IV). IEEE, 2011, pp. 163–168.
- “Social lstm: Human trajectory prediction in crowded spaces,” in CVPR, 2016, pp. 961–971.
- “Stgat: Modeling spatial-temporal interactions for human trajectory prediction,” in CVPR, 2019, pp. 6272–6281.
- “Social gan: Socially acceptable trajectories with generative adversarial networks,” in CVPR, 2018, pp. 2255–2264.
- “Trajectron++: Dynamically-feasible trajectory forecasting with heterogeneous data,” in ECCV. Springer, 2020, pp. 683–700.
- “It is not the journey but the destination: Endpoint conditioned trajectory prediction,” in ECCV. Springer, 2020, pp. 759–776.
- “Groupnet: Multiscale hypergraph neural networks for trajectory prediction with relational reasoning,” in CVPR, 2022, pp. 6498–6507.
- “Stochastic trajectory prediction via motion indeterminacy diffusion,” in CVPR, 2022, pp. 17113–17122.
- “Forecasting human trajectory from scene history,” NeurIPS, vol. 35, pp. 24920–24933, 2022.
- “Remember intentions: retrospective-memory-based trajectory prediction,” in CVPR, 2022, pp. 6488–6497.
- “Habit and intention in everyday life: The multiple processes by which past behavior predicts future behavior.,” Psychological bulletin, vol. 124, no. 1, pp. 54, 1998.
- “Ask me anything: Dynamic memory networks for natural language processing,” in ICML. PMLR, 2016, pp. 1378–1387.
- “Analysis of recurrent neural networks for probabilistic modeling of driver behavior,” TITS, vol. 18, no. 5, pp. 1289–1298, 2016.
- “Ss-lstm: A hierarchical lstm model for pedestrian trajectory prediction,” in WACV. IEEE, 2018, pp. 1186–1194.
- “Mantra: Memory augmented networks for multiple trajectory prediction,” in CVPR, 2020, pp. 7143–7152.
- “Continual multi-agent interaction behavior prediction with conditional generative memory,” RAL, vol. 6, no. 4, pp. 8410–8417, 2021.
- “Temporal pyramid network for pedestrian trajectory prediction with multi-supervision,” in AAAI, 2021, vol. 35, pp. 2029–2037.
- “Social-implicit: Rethinking trajectory prediction evaluation and the effectiveness of implicit maximum likelihood estimation,” in ECCV. Springer, 2022, pp. 463–479.
- “Improving data association by joint modeling of pedestrian trajectories and groupings,” in ECCV. Springer, 2010, pp. 452–465.
- “Crowds by example,” in Computer graphics forum. Wiley Online Library, 2007, vol. 26, pp. 655–664.
- “Learning social etiquette: Human trajectory understanding in crowded scenes,” in ECCV. Springer, 2016, pp. 549–565.