Monocular Camera Localization for Automated Vehicles Using Image Retrieval (2109.06296v3)
Abstract: We address the problem of finding the current position and heading angle of an autonomous vehicle in real-time using a single camera. Compared to methods which require LiDARs and high definition (HD) 3D maps in real-time, the proposed approach is easily scalable and computationally efficient, at the price of lower precision. The new method combines and adapts existing algorithms in three different fields: image retrieval, mapping database, and particle filtering. The result is a simple, real-time localization method using an image retrieval method whose performance is comparable to other monocular camera localization methods which use a map built with LiDARs. We evaluate the proposed method using the KITTI odometry dataset and via closed-loop experiments with an indoor 1:10 autonomous vehicle. The tests demonstrate real-time capability and a 10cm level accuracy. Also, experimental results of the closed-loop indoor tests show the presence of a positive feedback loop between the localization error and the control error. Such phenomena is analysed in details at the end of the article.
- Netvlad: Cnn architecture for weakly supervised place recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 5297–5307, 2016.
- All about vlad. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pages 1578–1585, 2013.
- Learning less is more-6d camera localization via 3d surface regression. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4654–4662, 2018.
- Vizard: Reliable visual localization for autonomous vehicles in urban outdoor environments. In 2019 IEEE Intelligent Vehicles Symposium (IV), pages 1124–1130. IEEE, 2019.
- Monocular camera localization in 3d lidar maps. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 1926–1931. IEEE, 2016.
- Range image-based lidar localization for autonomous vehicles. arXiv preprint arXiv:2105.12121, 2021.
- Up to the limits: Autonomous audi tts. In 2012 IEEE Intelligent Vehicles Symposium, pages 541–547. IEEE, 2012.
- Are we ready for autonomous driving? the kitti vision benchmark suite. In Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
- Feature detection for vehicle localization in urban environments using a multilayer lidar. IEEE Transactions on Intelligent Transportation Systems, 17(2):420–429, 2015.
- Aggregating local descriptors into a compact image representation. In 2010 IEEE computer society conference on computer vision and pattern recognition, pages 3304–3311. IEEE, 2010.
- A new control approach for automated drifting in consideration of the driving characteristics of an expert human driver. Control Engineering Practice, 96:104293, 2020.
- Lane-level localization using an avm camera for an automated driving vehicle in urban environments. IEEE/ASME Transactions on Mechatronics, 22(1):280–290, 2016.
- Robust vehicle localization in urban environments using probabilistic maps. In 2010 IEEE International Conference on Robotics and Automation, pages 4372–4378. IEEE, 2010.
- A robust o (n) solution to the perspective-n-point problem. IEEE transactions on pattern analysis and machine intelligence, 34(7):1444–1450, 2012.
- D Lowe. Bobject recognition from local scale-invariant features,[in proc. 7th int. conf. Computer Vision, Kerkyra, Greece, pages 1150–1157, 1999.
- John Markoff. Google cars drive themseleves, in traffic. The New York Times, 9, 2010.
- Orb-slam: a versatile and accurate monocular slam system. IEEE transactions on robotics, 31(5):1147–1163, 2015.
- Orb: An efficient alternative to sift or surf. In 2011 International conference on computer vision, pages 2564–2571. Ieee, 2011.
- Hyperpoints and fine vocabularies for large-scale location recognition. In Proceedings of the IEEE International Conference on Computer Vision, pages 2102–2110, 2015.
- Efficient & effective prioritized matching for large-scale image-based localization. IEEE transactions on pattern analysis and machine intelligence, 39(9):1744–1756, 2016.
- Photo tourism: exploring photo collections in 3d. In ACM siggraph 2006 papers, pages 835–846. 2006.
- Richard Szeliski. Computer vision: algorithms and applications. Springer Science & Business Media, 2010.
- Sebastian Thrun. Probabilistic robotics. Communications of the ACM, 45(3):52–57, 2002.
- 24/7 place recognition by view synthesis. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1808–1817, 2015.
- Are large-scale 3d models really necessary for accurate visual localization? IEEE transactions on pattern analysis and machine intelligence, 2019.
- Autonomous driving in urban environments: Boss and the urban challenge. Journal of Field Robotics, 25(8):425–466, 2008.
- Global positioning system-based vehicle control for automated parking. Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, 220(1):37–52, 2006.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.