Papers
Topics
Authors
Recent
Search
2000 character limit reached

Diffusion Models for Multi-target Adversarial Tracking

Published 12 Jul 2023 in cs.RO, cs.LG, and cs.MA | (2307.06244v2)

Abstract: Target tracking plays a crucial role in real-world scenarios, particularly in drug-trafficking interdiction, where the knowledge of an adversarial target's location is often limited. Improving autonomous tracking systems will enable unmanned aerial, surface, and underwater vehicles to better assist in interdicting smugglers that use manned surface, semi-submersible, and aerial vessels. As unmanned drones proliferate, accurate autonomous target estimation is even more crucial for security and safety. This paper presents Constrained Agent-based Diffusion for Enhanced Multi-Agent Tracking (CADENCE), an approach aimed at generating comprehensive predictions of adversary locations by leveraging past sparse state information. To assess the effectiveness of this approach, we evaluate predictions on single-target and multi-target pursuit environments, employing Monte-Carlo sampling of the diffusion model to estimate the probability associated with each generated trajectory. We propose a novel cross-attention based diffusion model that utilizes constraint-based sampling to generate multimodal track hypotheses. Our single-target model surpasses the performance of all baseline methods on Average Displacement Error (ADE) for predictions across all time horizons.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. Image inpainting. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques, pages 417–424, 2000.
  2. Multi-class object tracking algorithm that handles fragmentation and grouping. In 2007 IEEE Conference on Computer Vision and Pattern Recognition, pages 1–8, 2007.
  3. Mixture kalman filters. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 62(3):493–508, 2000.
  4. Diffusion policy: Visuomotor policy learning via action diffusion. In Proceedings of Robotics: Science and Systems (RSS), 2023.
  5. Diffusion models in vision: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
  6. Diffusion models beat gans on image synthesis. Advances in Neural Information Processing Systems, 34:8780–8794, 2021.
  7. Target tracking by particle filtering in binary sensor networks. IEEE Transactions on signal processing, 56(6):2229–2238, 2008.
  8. Constrained multi-target tracking for team sports activities. IPSJ Transactions on Computer Vision and Applications, 10:1–11, 2018.
  9. Learning policy representations in multiagent systems. In International conference on machine learning, pages 1802–1811. PMLR, 2018.
  10. Power conservation and quality of surveillance in target tracking sensor networks. In Proceedings of the 10th annual international conference on Mobile computing and networking, pages 129–143, 2004.
  11. Opponent modeling in deep reinforcement learning. In International conference on machine learning, pages 1804–1813. PMLR, 2016.
  12. Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems, 33:6840–6851, 2020.
  13. Cascaded diffusion models for high fidelity image generation. J. Mach. Learn. Res., 23(47):1–33, 2022.
  14. Planning with diffusion for flexible behavior synthesis. In International Conference on Machine Learning, 2022.
  15. Target tracking algorithm based on adaptive strong tracking particle filter. IET Science, Measurement & Technology, 10(7):704–710, 2016.
  16. A survey of unmanned aerial vehicles (uavs) for traffic monitoring. In 2013 International Conference on Unmanned Aircraft Systems (ICUAS), pages 221–234. IEEE, 2013.
  17. Adam: A method for stochastic optimization. In Yoshua Bengio and Yann LeCun, editors, 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015.
  18. Unscented kalman filters for multiple target tracking with symmetric measurement equations. IEEE Transactions on Automatic Control, 54(2):370–375, 2009.
  19. Deepmtt: A deep learning maneuvering target-tracking algorithm based on bidirectional lstm network. Information Fusion, 53:289–304, 2020.
  20. Structdiffusion: Object-centric diffusion for semantic rearrangement of novel objects. arXiv preprint arXiv:2211.04604, 2022.
  21. Repaint: Inpainting using denoising diffusion probabilistic models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11461–11471, 2022.
  22. Integrated track splitting filter - efficient multi-scan single target tracking in clutter. IEEE Transactions on Aerospace and Electronic Systems, 43(4):1409–1425, 2007.
  23. A survey of opponent modeling in adversarial domains. Journal of Artificial Intelligence Research, 73:277–327, 2022.
  24. Deep learning to frame objects for visual target tracking. Engineering Applications of Artificial Intelligence, 65:406–420, 2017.
  25. Film: Visual reasoning with a general conditioning layer. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 32, 2018.
  26. Modeling others using oneself in multi-agent reinforcement learning. In International conference on machine learning, pages 4257–4266. PMLR, 2018.
  27. G Mallikarjuna Rao and Ch Satyanarayana. Visual object target tracking using particle filter: a survey. International Journal of Image, Graphics and Signal Processing, 5(6):1250, 2013.
  28. Progressive distillation for fast sampling of diffusion models. In International Conference on Learning Representations, 2022.
  29. Unmanned aerial vehicles (uavs): A survey on civil applications and key research challenges. IEEE Access, 7:48572–48634, 2019.
  30. Deep unsupervised learning using nonequilibrium thermodynamics. In Francis Bach and David Blei, editors, Proceedings of the 32nd International Conference on Machine Learning, volume 37 of Proceedings of Machine Learning Research, pages 2256–2265, Lille, France, 07–09 Jul 2015. PMLR.
  31. Object tracking methods: a review. In 2019 9th International Conference on Computer and Knowledge Engineering (ICCKE), pages 282–288. IEEE, 2019.
  32. Score-based generative modeling through stochastic differential equations. In International Conference on Learning Representations, 2021.
  33. Target tracking for sensor networks: A survey. ACM Computing Surveys (CSUR), 49(2):1–31, 2016.
  34. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  35. Single target tracking using adaptive clustered decision trees and dynamic multi-level appearance models. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015.
  36. Learning models of adversarial agent behavior under partial observability. Proceedings of the International Conference on Intelligent Robots and Systems, 2023. To appear.
  37. Madiff: Offline multi-agent learning with diffusion models. arXiv preprint arXiv:2305.17330, 2023.
Citations (3)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.