Papers
Topics
Authors
Recent
Search
2000 character limit reached

Visual Servoing on Wheels: Robust Robot Orientation Estimation in Remote Viewpoint Control

Published 26 Jun 2023 in cs.RO | (2306.14848v1)

Abstract: This work proposes a fast deployment pipeline for visually-servoed robots which does not assume anything about either the robot - e.g. sizes, colour or the presence of markers - or the deployment environment. In this, accurate estimation of robot orientation is crucial for successful navigation in complex environments; manual labelling of angular values is, though, time-consuming and possibly hard to perform. For this reason, we propose a weakly supervised pipeline that can produce a vast amount of data in a small amount of time. We evaluate our approach on a dataset of remote camera images captured in various indoor environments demonstrating high tracking performances when integrated into a fully-autonomous pipeline with a simple controller. With this, we then analyse the data requirement of our approach, showing how it is possible to deploy a new robot in a new environment in less than 30.00 min.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (25)
  1. X. Liang, H. Wang, W. Chen, D. Guo, and T. Liu, “Adaptive Image-Based Trajectory Tracking Control of Wheeled Mobile Robots With an Uncalibrated Fixed Camera,” IEEE Transactions on Control Systems Technology, vol. 23, pp. 2266–2282, Nov. 2015. Conference Name: IEEE Transactions on Control Systems Technology.
  2. X. Liang, H. Wang, Y.-H. Liu, Z. Liu, B. You, Z. Jing, and W. Chen, “Purely Image-Based Pose Stabilization of Nonholonomic Mobile Robots With a Truly Uncalibrated Overhead Camera,” IEEE Transactions on Robotics, vol. 36, pp. 724–742, June 2020. Conference Name: IEEE Transactions on Robotics.
  3. J. H. Shim and Y. I. Cho, “A mobile robot localization via indoor fixed remote surveillance cameras,” Sensors, vol. 16, no. 2, p. 195, 2016.
  4. D. Flögel, N. P. Bhatt, and E. Hashemi, “Infrastructure-aided localization and state estimation for autonomous mobile robots,” Robotics, vol. 11, no. 4, p. 82, 2022.
  5. G. J. Agin, “Computer vision systems for industrial inspection and assembly,” Computer, vol. 13, no. 05, pp. 11–20, 1980.
  6. G. Flandin, F. Chaumette, and E. Marchand, “Eye-in-hand/eye-to-hand cooperation for visual servoing,” in Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065), vol. 3, pp. 2741–2746 vol.3, 2000.
  7. V. Lippiello, B. Siciliano, and L. Villani, “Visual motion estimation of 3d objects: an adaptive extended kalman filter approach,” in 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)(IEEE Cat. No. 04CH37566), vol. 1, pp. 957–962, IEEE, 2004.
  8. F. Janabi-Sharifi and M. Marey, “A kalman-filter-based method for pose estimation in visual servoing,” IEEE Transactions on Robotics, vol. 26, no. 5, pp. 939–947, 2010.
  9. Y. Xue, W. Song, C.-Y. Su, P. Wang, and W. Feng, “Performance comparison of image-based and position-based visual servoing for object grasping with a robotic hand-arm system,” IEEE Access, vol. 9, pp. 117162–117174, 2021.
  10. A. Shademan and F. Janabi-Sharifi, “Sensitivity analysis of ekf and iterated ekf pose estimation for position-based visual servoing,” in Proceedings of 2005 IEEE Conference on Control Applications, 2005. CCA 2005., pp. 755–760, IEEE, 2005.
  11. K. S. Tsakalis, P. Boulas, and Z. Doulgeri, “An adaptive hierarchical controller for precision visual servoing using an uncalibrated eye-in-hand robotic system,” Robotics and Autonomous Systems, vol. 118, pp. 74–86, 2019.
  12. E. Malis, F. Chaumette, and S. Boudet, “2 1/2 d visual servoing,” IEEE Transactions on Robotics and Automation, vol. 15, no. 2, pp. 238–250, 1999.
  13. Z. Machkour, D. Ortiz-Arroyo, and P. Durdevic, “Classical and Deep Learning based Visual Servoing Systems: a Survey on State of the Art,” Journal of Intelligent & Robotic Systems, vol. 104, p. 11, Jan. 2022.
  14. W. Dixon, D. Dawson, E. Zergeroglu, and A. Behal, “Adaptive tracking control of a wheeled mobile robot via an uncalibrated camera system,” IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 31, pp. 341–352, June 2001. Conference Name: IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).
  15. C. Wang, Y. Mei, Z. Liang, and Q. Jia, “Dynamic feedback tracking control of non-holonomic mobile robots with unknown camera parameters,” Transactions of the Institute of Measurement and Control, vol. 32, no. 2, pp. 155–169, 2010.
  16. F. Yang, H. Su, C. Wang, and Z. Li, “Adaptive and sliding mode tracking control for wheeled mobile robots with unknown visual parameters,” Transactions of the Institute of Measurement and Control, p. 10, 2018.
  17. T. Diwan, G. Anirudh, and J. V. Tembhurne, “Object detection using yolo: Challenges, architectural successors, datasets and applications,” Multimedia Tools and Applications, pp. 1–33, 2022.
  18. N. Ruiz, E. Chong, and J. M. Rehg, “Fine-grained head pose estimation without keypoints,” in Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp. 2074–2083, 2018.
  19. D. H. Dos Reis, D. Welfer, M. A. De Souza Leite Cuadros, and D. F. T. Gamarra, “Mobile robot navigation using an object recognition software with rgbd images and the yolo algorithm,” Applied Artificial Intelligence, vol. 33, no. 14, pp. 1290–1305, 2019.
  20. J.-P. Lin and M.-T. Sun, “A yolo-based traffic counting system,” in 2018 Conference on Technologies and Applications of Artificial Intelligence (TAAI), pp. 82–85, IEEE, 2018.
  21. S. Xie, Y. Zhou, I. Zhong, W. Yan, and Q. Zhang, “A package auto-counting model based on tailored yolo and deepsort techniques,” in MATEC Web of Conferences, vol. 355, p. 02054, EDP Sciences, 2022.
  22. Z. Li, X. Tian, X. Liu, Y. Liu, and X. Shi, “A two-stage industrial defect detection framework based on improved-yolov5 and optimized-inception-resnetv2 models,” Applied Sciences, vol. 12, no. 2, p. 834, 2022.
  23. M. Tan and Q. Le, “Efficientnet: Rethinking model scaling for convolutional neural networks,” in International conference on machine learning, pp. 6105–6114, PMLR, 2019.
  24. world scientific, 2001.
  25. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE conference on computer vision and pattern recognition, pp. 248–255, Ieee, 2009.
Citations (3)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up