2000 character limit reached
SWTrack: Multiple Hypothesis Sliding Window 3D Multi-Object Tracking (2402.17892v2)
Published 27 Feb 2024 in cs.RO
Abstract: Modern robotic systems are required to operate in dense dynamic environments, requiring highly accurate real-time track identification and estimation. For 3D multi-object tracking, recent approaches process a single measurement frame recursively with greedy association and are prone to errors in ambiguous association decisions. Our method, Sliding Window Tracker (SWTrack), yields more accurate association and state estimation by batch processing many frames of sensor data while being capable of running online in real-time. The most probable track associations are identified by evaluating all possible track hypotheses across the temporal sliding window. A novel graph optimization approach is formulated to solve the multidimensional assignment problem with lifted graph edges introduced to account for missed detections and graph sparsity enforced to retain real-time efficiency. We evaluate our SWTrack implementation${2}$ on the NuScenes autonomous driving dataset to demonstrate improved tracking performance.
- T. Yin, X. Zhou, and P. Krahenbuhl, “Center-based 3d object detection and tracking,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 11 784–11 793.
- Y. Chen, J. Liu, X. Zhang, X. Qi, and J. Jia, “VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Tracking,” in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 21 674–21 683.
- A. Kim, A. Ošep, and L. Leal-Taixé, “EagerMOT: 3D Multi-Object Tracking via Sensor Fusion,” in 2021 IEEE International Conference on Robotics and Automation (ICRA), May 2021, pp. 11 315–11 321.
- H.-K. Chiu, J. Li, R. Ambruş, and J. Bohg, “Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving,” in 2021 IEEE International Conference on Robotics and Automation (ICRA), May 2021, pp. 14 227–14 233.
- X. Weng, J. Wang, D. Held, and K. Kitani, “3D Multi-Object Tracking: A Baseline and New Evaluation Metrics,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Oct. 2020, pp. 10 359–10 366.
- H. W. Kuhn, “The hungarian method for the assignment problem,” Naval research logistics quarterly, vol. 2, no. 1-2, pp. 83–97, 1955.
- D. F. Crouse, “On implementing 2D rectangular assignment algorithms,” IEEE Transactions on Aerospace and Electronic Systems, vol. 52, no. 4, pp. 1679–1696, Aug. 2016.
- L. Wang, X. Zhang, W. Qin, X. Li, J. Gao, L. Yang, Z. Li, J. Li, L. Zhu, H. Wang, and H. Liu, “CAMO-MOT: Combined Appearance-Motion Optimization for 3D Multi-Object Tracking With Camera-LiDAR Fusion,” IEEE Transactions on Intelligent Transportation Systems, pp. 1–16, 2023.
- Y. Zeng, C. Ma, Z. Ming, Z. Fan, and X. Yang, “Cross-Modal 3D Object Detection and Tracking for Auto-Driving,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Sept. 2021, p. 8.
- C. Luo, X. Yang, and A. Yuille, “Exploring Simple 3D Multi-Object Tracking for Autonomous Driving,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 10 488–10 497.
- Z. Pang, J. Li, P. Tokmakov, D. Chen, S. Zagoruyko, and Y.-X. Wang, “Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Tracking,” in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Vancouver, BC, Canada: IEEE, June 2023, pp. 17 928–17 938.
- J. Kini, A. Mian, and M. Shah, “3DMODT: Attention-Guided Affinities for Joint Detection & Tracking in 3D Point Clouds,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), May 2023, pp. 841–848.
- D. Reid, “An algorithm for tracking multiple targets,” IEEE Transactions on Automatic Control, vol. 24, no. 6, pp. 843–854, Dec. 1979.
- S. Blackman, “Multiple hypothesis tracking for multiple target tracking,” IEEE Aerospace and Electronic Systems Magazine, vol. 19, no. 1, pp. 5–18, Jan. 2004.
- S. Deb, M. Yeddanapudi, K. Pattipati, and Y. Bar-Shalom, “A generalized sd assignment algorithm for multisensor-multitarget state estimation,” IEEE Transactions on Aerospace and Electronic systems, vol. 33, no. 2, pp. 523–538, 1997.
- A. B. Poore, “Multidimensional assignment formulation of data association problems arising from multitarget and multisensor tracking,” Computational Optimization and Applications, vol. 3, no. 1, pp. 27–57, 1994.
- R. W. Sittler, “An optimal data association problem in surveillance theory,” IEEE transactions on military electronics, vol. 8, no. 2, pp. 125–139, 1964.
- Z. Liu, H. Tang, A. Amini, X. Yang, H. Mao, D. L. Rus, and S. Han, “BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird’s-Eye View Representation,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), May 2023, pp. 2774–2781.
- H. Caesar, V. Bankiti, A. H. Lang, S. Vora, V. E. Liong, Q. Xu, A. Krishnan, Y. Pan, G. Baldan, and O. Beijbom, “nuScenes: A Multimodal Dataset for Autonomous Driving,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle, WA, USA: IEEE, June 2020, pp. 11 618–11 628.
- Gurobi Optimization, LLC, “Gurobi Optimizer Reference Manual,” 2023. [Online]. Available: https://www.gurobi.com
- K. Bernardin and R. Stiefelhagen, “Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics,” EURASIP Journal on Image and Video Processing, vol. 2008, pp. 1–10, 2008.
- H.-k. Chiu, A. Prioletti, J. Li, and J. Bohg, “Probabilistic 3D Multi-Object Tracking for Autonomous Driving,” arXiv:2001.05673 [cs], Jan. 2020.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
