Papers
Topics
Authors
Recent
Search
2000 character limit reached

Twilight SLAM: Navigating Low-Light Environments

Published 22 Apr 2023 in cs.RO | (2304.11310v4)

Abstract: This paper presents a detailed examination of low-light visual Simultaneous Localization and Mapping (SLAM) pipelines, focusing on the integration of state-of-the-art (SOTA) low-light image enhancement algorithms with standard and contemporary SLAM frameworks. The primary objective of our work is to address a pivotal question: Does illuminating visual input significantly improve localization accuracy in both semi-dark and dark environments? In contrast to previous works that primarily address partially dim-lit datasets, we comprehensively evaluate various low-light SLAM pipelines across obscurely-lit environments. Employing a meticulous experimental approach, we qualitatively and quantitatively assess different combinations of image enhancers and SLAM frameworks, identifying the best-performing combinations for feature-based visual SLAM. The findings advance low-light SLAM by highlighting the practical implications of enhancing visual input for improved localization accuracy in challenging lighting conditions. This paper also offers valuable insights, encouraging further exploration of visual enhancement strategies for enhanced SLAM performance in real-world scenarios.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (23)
  1. N. Karlsson, E. Di Bernardo, J. Ostrowski, L. Goncalves, P. Pirjanian, and M. E. Munich, “The vslam algorithm for robust localization and mapping,” in Proceedings of the 2005 IEEE international conference on robotics and automation.   IEEE, 2005, pp. 24–29.
  2. A. Savinykh, M. Kurenkov, E. Kruzhkov, E. Yudin, A. Potapov, P. Karpyshev, and D. Tsetserukou, “Darkslam: Gan-assisted visual slam for reliable operation in low-light conditions,” in 2022 IEEE 95th Vehicular Technology Conference:(VTC2022-Spring).   IEEE, 2022, pp. 1–6.
  3. I. Kalinov, A. Petrovsky, V. Ilin, E. Pristanskiy, M. Kurenkov, V. Ramzhaev, I. Idrisov, and D. Tsetserukou, “Warevision: Cnn barcode detection-based uav trajectory optimization for autonomous warehouse stocktaking,” IEEE Robotics and Automation Letters, vol. 5, no. 4, pp. 6647–6653, 2020.
  4. X. Guo, Y. Li, and H. Ling, “Lime: Low-light image enhancement via illumination map estimation,” IEEE Transactions on Image Processing, vol. 26, no. 2, pp. 982–993, 2017.
  5. Y. Jiang, X. Gong, D. Liu, Y. Cheng, C. Fang, X. Shen, J. Yang, P. Zhou, and Z. Wang, “Enlightengan: Deep light enhancement without paired supervision,” IEEE transactions on image processing, vol. 30, pp. 2340–2349, 2021.
  6. C. Guo, C. Li, J. Guo, C. C. Loy, J. Hou, S. Kwong, and R. Cong, “Zero-reference deep curve estimation for low-light image enhancement,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 1780–1789.
  7. M. Ferrera, A. Eudes, J. Moras, M. Sanfourche, and G. Le Besnerais, “Ov2slam: A fully online and versatile visual slam for real-time applications,” IEEE robotics and automation letters, vol. 6, no. 2, pp. 1399–1406, 2021.
  8. Z. Min and E. Dunn, “Voldor+ slam: For the times when feature-based or direct methods are not good enough,” in 2021 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2021, pp. 13 813–13 819.
  9. R. Mur-Artal and J. D. Tardós, “Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras,” IEEE transactions on robotics, vol. 33, no. 5, pp. 1255–1262, 2017.
  10. Y. Zhao and P. A. Vela, “Good feature matching: Toward accurate, robust vo/vslam with low latency,” IEEE Transactions on Robotics, vol. 36, no. 3, pp. 657–675, 2020.
  11. P. Ross, A. English, D. Ball, B. Upcroft, G. Wyeth, and P. Corke, “A novel method for analysing lighting variance,” in Australian Conference on Robotics and Automation, 2013.
  12. P. Ross, A. English, D. Ball, and P. Corke, “A method to quantify a descriptor’s illumination variance,” in Proceedings of the 16th Australasian Conference on Robotics and Automation 2014.   Australian Robotics and Automation Association (ARAA), 2014, pp. 1–8.
  13. E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, “Orb: An efficient alternative to sift or surf,” in 2011 International conference on computer vision.   Ieee, 2011, pp. 2564–2571.
  14. P.-E. Sarlin, D. DeTone, T. Malisiewicz, and A. Rabinovich, “Superglue: Learning feature matching with graph neural networks,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 4938–4947.
  15. D. DeTone, T. Malisiewicz, and A. Rabinovich, “Superpoint: Self-supervised interest point detection and description,” in Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2018, pp. 224–236.
  16. P.-E. Sarlin, A. Unagar, M. Larsson, H. Germain, C. Toft, V. Larsson, M. Pollefeys, V. Lepetit, L. Hammarstrand, F. Kahl et al., “Back to the feature: Learning robust camera localization from pixels to pose,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 3247–3257.
  17. L. Hao, H. Li, Q. Zhang, X. Hu, and J. Cheng, “Lmvi-slam: Robust low-light monocular visual-inertial simultaneous localization and mapping,” in 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO), 2019, pp. 272–277.
  18. H. Porav, W. Maddern, and P. Newman, “Adversarial training for adverse conditions: Robust metric localisation using appearance transfer,” in 2018 IEEE international conference on robotics and automation (ICRA).   IEEE, 2018, pp. 1011–1018.
  19. X. Guo and Q. Hu, “Low-light image enhancement via breaking down the darkness,” International Journal of Computer Vision, vol. 131, no. 1, pp. 48–66, 2023.
  20. Q. Zhang, Y. Nie, and W.-S. Zheng, “Dual illumination estimation for robust exposure correction,” in Computer Graphics Forum, vol. 38, no. 7.   Wiley Online Library, 2019, pp. 243–252.
  21. C. Campos, R. Elvira, J. J. G. Rodríguez, J. M. Montiel, and J. D. Tardós, “Orb-slam3: An accurate open-source library for visual, visual–inertial, and multimap slam,” IEEE Transactions on Robotics, vol. 37, no. 6, pp. 1874–1890, 2021.
  22. C. Theodorou, V. Velisavljevic, and V. Dyo, “Visual slam for dynamic environments based on object detection and optical flow for dynamic object removal,” Sensors, vol. 22, no. 19, p. 7553, 2022.
  23. D. Gálvez-López and J. D. Tardos, “Bags of binary words for fast place recognition in image sequences,” IEEE Transactions on Robotics, vol. 28, no. 5, pp. 1188–1197, 2012.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up