Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Take Your Best Shot: Sampling-Based Planning for Autonomous Photography (2403.05477v2)

Published 8 Mar 2024 in cs.RO

Abstract: Autonomous mobile robots (AMRs) equipped with high-quality cameras have revolutionized the field of inspections by providing efficient and cost-effective means of conducting surveys. The use of autonomous inspection is becoming more widespread in a variety of contexts, yet it is still challenging to acquire the best inspection information autonomously. In situations where objects may block a robot's view, it is necessary to use reasoning to determine the optimal points for collecting data. Although researchers have explored cloud-based applications to store inspection data, these applications may not operate optimally under network constraints, and parsing these datasets can be manually intensive. Instead, there is an emerging requirement for AMRs to autonomously capture the most informative views efficiently. To address this challenge, we present an autonomous Next-Best-View (NBV) framework that maximizes the inspection information while reducing the number of pictures needed during operations. The framework consists of a formalized evaluation metric using ray-tracing and Gaussian process interpolation to estimate information reward based on the current understanding of the partially-known environment. A derivative-free optimization (DFO) method is used to sample candidate views in the environment and identify the NBV point. The proposed approach's effectiveness is shown by comparing it with existing methods and further validated through simulations and experiments with various vehicles.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (24)
  1. M. Zabarauskas and S. Cameron, “Luke: An autonomous robot photographer,” in 2014 ieee international conference on robotics and automation (icra).   IEEE, 2014, pp. 1809–1815.
  2. B. Sutter, A. Lelevé, M. T. Pham, O. Gouin, N. Jupille, M. Kuhn, P. Lulé, P. Michaud, and P. Rémy, “A semi-autonomous mobile robot for bridge inspection,” Automation in Construction, vol. 91, pp. 111–119, 2018.
  3. B. Joshi, M. Xanthidis, M. Roznere, N. J. Burgdorfer, P. Mordohai, A. Q. Li, and I. Rekleitis, “Underwater exploration and mapping,” in 2022 IEEE/OES Autonomous Underwater Vehicles Symposium (AUV), 2022, pp. 1–7.
  4. Z. Byers, M. Dixon, K. Goodier, C. M. Grimm, and W. D. Smart, “An autonomous robot photographer,” in Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003)(Cat. No. 03CH37453), vol. 3.   IEEE, 2003, pp. 2636–2641.
  5. R. Montero, J. G. Victores, S. Martinez, A. Jardón, and C. Balaguer, “Past, present and future of robotic tunnel inspection,” Automation in Construction, vol. 59, pp. 99–112, 2015.
  6. C. Connolly, “The determination of next best views,” in Proceedings. 1985 IEEE international conference on robotics and automation, vol. 2.   IEEE, 1985, pp. 432–435.
  7. M. Naazare, F. G. Rosas, and D. Schulz, “Online next-best-view planner for 3d-exploration and inspection with a mobile manipulator robot,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 3779–3786, 2022.
  8. Y. Han, I. H. Zhan, W. Zhao, and Y.-J. Liu, “A double branch next-best-view network and novel robot system for active object reconstruction,” in 2022 International Conference on Robotics and Automation (ICRA).   IEEE, 2022, pp. 7306–7312.
  9. H. Dhami, V. D. Sharma, and P. Tokekar, “Map-nbv: Multi-agent prediction-guided next-best-view planning for active 3d object reconstruction,” arXiv preprint arXiv:2307.04004, 2023.
  10. X. Zeng, T. Zaenker, and M. Bennewitz, “Deep reinforcement learning for next-best-view planning in agricultural applications,” in 2022 International Conference on Robotics and Automation (ICRA).   IEEE, 2022, pp. 2323–2329.
  11. A. Bircher, M. Kamel, K. Alexis, H. Oleynikova, and R. Siegwart, “Receding horizon” next-best-view” planner for 3d exploration,” in 2016 IEEE international conference on robotics and automation (ICRA).   IEEE, 2016, pp. 1462–1468.
  12. R. Almadhoun, A. Abduldayem, T. Taha, L. Seneviratne, and Y. Zweiri, “Guided next best view for 3d reconstruction of large complex structures,” Remote Sensing, vol. 11, no. 20, p. 2440, 2019.
  13. R. Monica, J. Aleotti, and D. Piccinini, “Humanoid robot next best view planning under occlusions using body movement primitives,” in 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2019, pp. 2493–2500.
  14. I. Lluvia, E. Lazkano, and A. Ansuategi, “Active mapping and robot exploration: A survey,” Sensors, vol. 21, no. 7, p. 2445, 2021.
  15. D. Friedman and Y. A. Feldman, “Automated cinematic reasoning about camera behavior,” Expert Systems with Applications, vol. 30, no. 4, pp. 694–704, 2006.
  16. A. Asgharivaskasi and N. Atanasov, “Active bayesian multi-class mapping from range and semantic segmentation observations,” in 2021 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2021, pp. 1–7.
  17. J. I. Vásquez-Gómez, E. Löpez-Damian, and L. E. Sucar, “View planning for 3d object reconstruction,” in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.   IEEE, 2009, pp. 4015–4020.
  18. J. I. Vasquez-Gomez, L. E. Sucar, and R. Murrieta-Cid, “Hierarchical ray tracing for fast volumetric next-best-view planning,” in 2013 International conference on computer and robot vision.   IEEE, 2013, pp. 181–187.
  19. E. Yel and N. Bezzo, “Gp-based runtime planning, learning, and recovery for safe uav operations under unforeseen disturbances,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2020, pp. 2173–2180.
  20. M. Corah, C. O’Meadhra, K. Goel, and N. Michael, “Communication-efficient planning and mapping for multi-robot exploration in large environments,” IEEE Robotics and Automation Letters, vol. 4, no. 2, pp. 1715–1721, 2019.
  21. L. Kang, R.-S. Chen, N. Xiong, Y.-C. Chen, Y.-X. Hu, and C.-M. Chen, “Selecting hyper-parameters of gaussian process regression based on non-inertial particle swarm optimization in internet of things,” IEEE Access, vol. 7, pp. 59 504–59 513, 2019.
  22. Y. Zhang, D.-w. Gong, and J.-h. Zhang, “Robot path planning in uncertain environment using multi-objective particle swarm optimization,” Neurocomputing, vol. 103, pp. 172–185, 2013.
  23. V. M. Respall, D. Devitt, R. Fedorenko, and A. Klimchik, “Fast sampling-based next-best-view exploration algorithm for a mav,” in 2021 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2021, pp. 89–95.
  24. A. Hornung, K. M. Wurm, M. Bennewitz, C. Stachniss, and W. Burgard, “Octomap: An efficient probabilistic 3d mapping framework based on octrees,” Autonomous robots, vol. 34, pp. 189–206, 2013.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now