Diffusion Models for Multi-target Adversarial Tracking
Abstract: Target tracking plays a crucial role in real-world scenarios, particularly in drug-trafficking interdiction, where the knowledge of an adversarial target's location is often limited. Improving autonomous tracking systems will enable unmanned aerial, surface, and underwater vehicles to better assist in interdicting smugglers that use manned surface, semi-submersible, and aerial vessels. As unmanned drones proliferate, accurate autonomous target estimation is even more crucial for security and safety. This paper presents Constrained Agent-based Diffusion for Enhanced Multi-Agent Tracking (CADENCE), an approach aimed at generating comprehensive predictions of adversary locations by leveraging past sparse state information. To assess the effectiveness of this approach, we evaluate predictions on single-target and multi-target pursuit environments, employing Monte-Carlo sampling of the diffusion model to estimate the probability associated with each generated trajectory. We propose a novel cross-attention based diffusion model that utilizes constraint-based sampling to generate multimodal track hypotheses. Our single-target model surpasses the performance of all baseline methods on Average Displacement Error (ADE) for predictions across all time horizons.
- Image inpainting. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques, pages 417–424, 2000.
- Multi-class object tracking algorithm that handles fragmentation and grouping. In 2007 IEEE Conference on Computer Vision and Pattern Recognition, pages 1–8, 2007.
- Mixture kalman filters. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 62(3):493–508, 2000.
- Diffusion policy: Visuomotor policy learning via action diffusion. In Proceedings of Robotics: Science and Systems (RSS), 2023.
- Diffusion models in vision: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
- Diffusion models beat gans on image synthesis. Advances in Neural Information Processing Systems, 34:8780–8794, 2021.
- Target tracking by particle filtering in binary sensor networks. IEEE Transactions on signal processing, 56(6):2229–2238, 2008.
- Constrained multi-target tracking for team sports activities. IPSJ Transactions on Computer Vision and Applications, 10:1–11, 2018.
- Learning policy representations in multiagent systems. In International conference on machine learning, pages 1802–1811. PMLR, 2018.
- Power conservation and quality of surveillance in target tracking sensor networks. In Proceedings of the 10th annual international conference on Mobile computing and networking, pages 129–143, 2004.
- Opponent modeling in deep reinforcement learning. In International conference on machine learning, pages 1804–1813. PMLR, 2016.
- Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems, 33:6840–6851, 2020.
- Cascaded diffusion models for high fidelity image generation. J. Mach. Learn. Res., 23(47):1–33, 2022.
- Planning with diffusion for flexible behavior synthesis. In International Conference on Machine Learning, 2022.
- Target tracking algorithm based on adaptive strong tracking particle filter. IET Science, Measurement & Technology, 10(7):704–710, 2016.
- A survey of unmanned aerial vehicles (uavs) for traffic monitoring. In 2013 International Conference on Unmanned Aircraft Systems (ICUAS), pages 221–234. IEEE, 2013.
- Adam: A method for stochastic optimization. In Yoshua Bengio and Yann LeCun, editors, 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015.
- Unscented kalman filters for multiple target tracking with symmetric measurement equations. IEEE Transactions on Automatic Control, 54(2):370–375, 2009.
- Deepmtt: A deep learning maneuvering target-tracking algorithm based on bidirectional lstm network. Information Fusion, 53:289–304, 2020.
- Structdiffusion: Object-centric diffusion for semantic rearrangement of novel objects. arXiv preprint arXiv:2211.04604, 2022.
- Repaint: Inpainting using denoising diffusion probabilistic models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11461–11471, 2022.
- Integrated track splitting filter - efficient multi-scan single target tracking in clutter. IEEE Transactions on Aerospace and Electronic Systems, 43(4):1409–1425, 2007.
- A survey of opponent modeling in adversarial domains. Journal of Artificial Intelligence Research, 73:277–327, 2022.
- Deep learning to frame objects for visual target tracking. Engineering Applications of Artificial Intelligence, 65:406–420, 2017.
- Film: Visual reasoning with a general conditioning layer. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 32, 2018.
- Modeling others using oneself in multi-agent reinforcement learning. In International conference on machine learning, pages 4257–4266. PMLR, 2018.
- G Mallikarjuna Rao and Ch Satyanarayana. Visual object target tracking using particle filter: a survey. International Journal of Image, Graphics and Signal Processing, 5(6):1250, 2013.
- Progressive distillation for fast sampling of diffusion models. In International Conference on Learning Representations, 2022.
- Unmanned aerial vehicles (uavs): A survey on civil applications and key research challenges. IEEE Access, 7:48572–48634, 2019.
- Deep unsupervised learning using nonequilibrium thermodynamics. In Francis Bach and David Blei, editors, Proceedings of the 32nd International Conference on Machine Learning, volume 37 of Proceedings of Machine Learning Research, pages 2256–2265, Lille, France, 07–09 Jul 2015. PMLR.
- Object tracking methods: a review. In 2019 9th International Conference on Computer and Knowledge Engineering (ICCKE), pages 282–288. IEEE, 2019.
- Score-based generative modeling through stochastic differential equations. In International Conference on Learning Representations, 2021.
- Target tracking for sensor networks: A survey. ACM Computing Surveys (CSUR), 49(2):1–31, 2016.
- Attention is all you need. Advances in neural information processing systems, 30, 2017.
- Single target tracking using adaptive clustered decision trees and dynamic multi-level appearance models. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015.
- Learning models of adversarial agent behavior under partial observability. Proceedings of the International Conference on Intelligent Robots and Systems, 2023. To appear.
- Madiff: Offline multi-agent learning with diffusion models. arXiv preprint arXiv:2305.17330, 2023.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.