Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Diffusion-Based Point Cloud Super-Resolution for mmWave Radar Data (2404.06012v1)

Published 9 Apr 2024 in cs.CV and cs.RO

Abstract: The millimeter-wave radar sensor maintains stable performance under adverse environmental conditions, making it a promising solution for all-weather perception tasks, such as outdoor mobile robotics. However, the radar point clouds are relatively sparse and contain massive ghost points, which greatly limits the development of mmWave radar technology. In this paper, we propose a novel point cloud super-resolution approach for 3D mmWave radar data, named Radar-diffusion. Our approach employs the diffusion model defined by mean-reverting stochastic differential equations(SDE). Using our proposed new objective function with supervision from corresponding LiDAR point clouds, our approach efficiently handles radar ghost points and enhances the sparse mmWave radar point clouds to dense LiDAR-like point clouds. We evaluate our approach on two different datasets, and the experimental results show that our method outperforms the state-of-the-art baseline methods in 3D radar super-resolution tasks. Furthermore, we demonstrate that our enhanced radar point cloud is capable of downstream radar point-based registration tasks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (25)
  1. P. Besl and N. McKay. A Method for Registration of 3D Shapes. IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 14(2):239–256, 1992.
  2. Deep radar detector. In 2019 IEEE Radar Conference (RadarConf), pages 1–6. IEEE, 2019.
  3. Ghost target detection in 3d radar data using point cloud based deep neural network. In Proc. of the Intl. Conf. on Pattern Recognition (ICPR), pages 10398–10403. IEEE, 2021.
  4. SuMa++: Efficient LiDAR-based Semantic SLAM. In Proc. of the IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (IROS), 2019.
  5. Symbolic discovery of optimization algorithms. arXiv preprint, 2023.
  6. A novel radar point cloud generation method for robot environment perception. IEEE Trans. on Robotics (TRO), 38(6):3754–3773, 2022.
  7. Guided generative adversarial network for super resolution of imaging radar. In 2020 17th European Radar Conference (EuRAD), pages 144–147. IEEE, 2021.
  8. Spectrum-based single-snapshot super-resolution direction-of-arrival estimation using deep learning. In 2020 German Microwave Conference (GeMiC), pages 184–187. IEEE, 2020.
  9. Through fog high-resolution imaging using millimeter wave radar. In Proc. of the IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pages 11464–11473, 2020.
  10. Denoising diffusion probabilistic models. Proc. of the Advances in Neural Information Processing Systems (NIPS), 33:6840–6851, 2020.
  11. Patchwork++: Fast and robust ground segmentation solving partial under-segmentation using 3d point cloud. In Proc. of the IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (IROS), pages 13276–13283. IEEE, 2022.
  12. Continuous control with deep reinforcement learning. arXiv preprint, 2015.
  13. Image restoration with mean-reverting stochastic differential equations. arXiv preprint, 2023.
  14. M. Mirza and S. Osindero. Conditional generative adversarial nets. arXiv preprint, 2014.
  15. Multi-class road user detection with 3+ 1d radar in the view-of-delft dataset. IEEE Robotics and Automation Letters (RA-L), 7:4961–4968, 2022.
  16. High resolution point clouds from mmwave radar. In Proc. of the IEEE Intl. Conf. on Robotics & Automation (ICRA), pages 4135–4142. IEEE, 2023.
  17. PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. In Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2017.
  18. M.A. Richards. Fundamentals of radar signal processing. McGraw-Hill Education, 2022.
  19. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 234–241. Springer, 2015.
  20. Palette: Image-to-image diffusion models. In ACM SIGGRAPH 2022 Conference Proceedings, pages 1–10, 2022.
  21. Keypoint Matching for Point Cloud Registration using Multiplex Dynamic Graph Attention Networks. IEEE Robotics and Automation Letters (RA-L), 6:8221–8228, 2021.
  22. Rdmnet: Reliable dense matching based point cloud registration for autonomous driving. IEEE Trans. on Intelligent Transportation Systems (T-ITS), 2023.
  23. Fast and accurate deep loop closing and relocalization for reliable lidar slam. arXiv preprint, 2023.
  24. Mcvd-masked conditional video diffusion for prediction, generation, and interpolation. Proc. of the Advances in Neural Information Processing Systems (NIPS), 35:23371–23385, 2022.
  25. mmeye: Super-resolution millimeter wave imaging. IEEE Internet of Things Journal, 8(8):6995–7008, 2020.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Kai Luan (1 paper)
  2. Chenghao Shi (8 papers)
  3. Neng Wang (25 papers)
  4. Yuwei Cheng (8 papers)
  5. Huimin Lu (60 papers)
  6. Xieyuanli Chen (77 papers)
Citations (1)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com