Papers
Topics
Authors
Recent
Search
2000 character limit reached

Staircase Localization for Autonomous Exploration in Urban Environments

Published 26 Mar 2024 in cs.CV | (2403.17330v1)

Abstract: A staircase localization method is proposed for robots to explore urban environments autonomously. The proposed method employs a modular design in the form of a cascade pipeline consisting of three modules of stair detection, line segment detection, and stair localization modules. The stair detection module utilizes an object detection algorithm based on deep learning to generate a region of interest (ROI). From the ROI, line segment features are extracted using a deep line segment detection algorithm. The extracted line segments are used to localize a staircase in terms of position, orientation, and stair direction. The stair detection and localization are performed only with a single RGB-D camera. Each component of the proposed pipeline does not need to be designed particularly for staircases, which makes it easy to maintain the whole pipeline and replace each component with state-of-the-art deep learning detection techniques. The results of real-world experiments show that the proposed method can perform accurate stair detection and localization during autonomous exploration for various structured and unstructured upstairs and downstairs with shadows, dirt, and occlusions by artificial and natural objects.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (27)
  1. K. Otsu, S. Tepsuporn, R. Thakker, T. S. Vaquero, J. A. Edlund, W. Walsh, G. Miles, T. Heywood, M. T. Wolf, and A.-A. Agha-Mohammadi, “Supervised Autonomy for Communication-degraded Subterranean Exploration by a Robot Team,” in 2020 IEEE Aerospace Conference, Big Sky, MT, USA, Mar. 2020.
  2. Quy-Hung Vu, Byeong-Sang Kim, and Jae-Bok Song, “Autonomous Stair Climbing Algorithm for a Small Four-tracked Robot,” in 2008 International Conference on Control, Automation and Systems, Seoul, South Korea, Oct. 2008.
  3. R. Munoz, Xuejian Rong, and Y. Tian, “Depth-aware Indoor Staircase Detection and Recognition for the Visually Impaired,” in 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Seattle, WA, USA, Jul. 2016.
  4. U. Patil, A. Gujarathi, A. Kulkarni, A. Jain, L. Malke, R. Tekade, K. Paigwar, and P. Chaturvedi, “Deep Learning Based Stair Detection and Statistical Image Filtering for Autonomous Stair Climbing,” in 2019 Third IEEE International Conference on Robotic Computing (IRC), Naples, Italy, Feb. 2019.
  5. C. Wang, Z. Pei, S. Qiu, and Z. Tang, “Deep Leaning-Based Ultra-Fast Stair Detection,” 2022, arXiv:2201.05275 [cs].
  6. E. Mihankhah, A. Kalantari, E. Aboosaeedan, H. Taghirad, S. Ali, and A. Moosavian, “Autonomous Staircase Detection and Stair Climbing for a Tracked Mobile Robot Using Fuzzy Controller,” in 2008 IEEE International Conference on Robotics and Biomimetics, Bangkok, Feb. 2009.
  7. G. Gu, B. Ko, S. Go, S.-H. Lee, J. Lee, and M. Shin, “Towards Light-Weight and Real-Time Line Segment Detection,” in Proceedings of the AAAI Conference on Artificial Intelligence, online, Feb. 2022.
  8. Xiaoye Lu and R. Manduchi, “Detection and Localization of Curbs and Stairways Using Stereo Vision,” in Proceedings of the 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain, 2005.
  9. J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You Only Look Once: Unified, Real-Time Object Detection,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, Jun. 2016.
  10. A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, “MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications,” 2017, arXiv:1704.04861 [cs].
  11. M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L.-C. Chen, “MobileNetV2: Inverted Residuals and Linear Bottlenecks,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, Jun. 2018.
  12. Y. Xu, W. Xu, D. Cheung, and Z. Tu, “Line Segment Detection Using Transformers Without Edges,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, online, Jun. 2021.
  13. S. Huang, F. Qin, P. Xiong, N. Ding, Y. He, and X. Liu, “TP-LSD: Tri-Points Based Line Segment Detector,” 2020, arXiv:2009.05505 [cs].
  14. J. Fourre, V. Vauchey, Y. Dupuis, and X. Savatier, “Autonomous RGBD-based Industrial Staircase Localization from Tracked Robots,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA, Oct. 2020.
  15. T. Westfechtel, K. Ohno, B. Mertsching, D. Nickchen, S. Kojima, and S. Tadokoro, “3D Graph based Stairway Detection and Localization for Mobile Robots,” in 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, South Korea, Oct. 2016.
  16. T. Westfechtel, K. Ohno, B. Mertsching, R. Hamada, D. Nickchen, S. Kojima, and S. Tadokoro, “Robust Stairway-detection and Localization Method for Mobile Robots Using a Graph-based Model and Competing Initializations,” The International Journal of Robotics Research, vol. 37, no. 12, pp. 1463–1483, Oct. 2018.
  17. A. Pérez-Yus, G. López-Nicolás, and J. J. Guerrero, “Detection and Modelling of Staircases Using a Wearable Depth Sensor,” in ECCV 2014, Zurich, Switzerland, Sep. 2015.
  18. A. Perez-Yus, D. Gutierrez-Gomez, G. Lopez-Nicolas, and J. Guerrero, “Stairs Detection with Odometry-aided Traversal from a Wearable RGB-D Camera,” Computer Vision and Image Understanding, vol. 154, pp. 192–205, Jan. 2017.
  19. K. Zhu, J. Zhan, S. Chen, Z. Nan, T. Zhang, D. Zhu, and N. Zheng, “ATV Navigation in Complex and Unstructured Environment Containing Stairs,” in 2020 IEEE Intelligent Vehicles Symposium (IV).   Las Vegas, NV, USA: IEEE, Oct. 2020, pp. 817–824.
  20. J. A. Sánchez-Rojas, J. A. Arias-Aguilar, H. Takemura, and A. E. Petrilli-Barceló, “Staircase Detection, Characterization and Approach Pipeline for Search and Rescue Robots,” Applied Sciences, vol. 11, no. 22, p. 10736, Nov. 2021.
  21. M. A. Fischler and R. C. Bolles, “Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography,” Communications of the ACM, vol. 24, no. 6, pp. 381–395, 1981.
  22. I. Vasiljevic, V. Guizilini, R. Ambrus, S. Pillai, W. Burgard, G. Shakhnarovich, and A. Gaidon, “Neural Ray Surfaces for Self-Supervised Learning of Depth and Ego-motion,” in 2020 International Conference on 3D Vision (3DV), Fukuoka, Japan, Nov. 2020.
  23. G. Jocher, “YOLOv5 by Ultralytics,” 5 2020. [Online]. Available: https://github.com/ultralytics/yolov5
  24. A. Agha, K. Otsu, B. Morrell, D. D. Fan, R. Thakker, A. Santamaria-Navarro, S.-K. Kim, A. Bouman, X. Lei, J. Edlund et al., “Nebula: Quest for robotic autonomy in challenging environments; team costar at the darpa subterranean challenge,” arXiv preprint arXiv:2103.11470, 2021.
  25. A.-a. Agha-mohammadi, S. Chakravorty, and N. M. Amato, “FIRM: Sampling-based Feedback Motion-planning under Motion Uncertainty and Imperfect Measurements,” The International Journal of Robotics Research, vol. 33, no. 2, pp. 268–304, Feb. 2014.
  26. S.-K. Kim, A. Bouman, G. Salhotra, D. D. Fan, K. Otsu, J. Burdick, and A.-a. Agha-mohammadi, “PLGRIM: Hierarchical Value Learning for Large-scale Exploration in Unknown Environments,” in Proceedings of the International Conference on Automated Planning and Scheduling, vol. 31, Guangzhou, China, Aug. 2021, pp. 652–662.
  27. M. Elmasry, “Stairs Detection and Modelling Using RGB-D Images,” Ph.D. dissertation, 2013.

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.