Papers
Topics
Authors
Recent
Search
2000 character limit reached

Adaptive Probabilistic Planning for the Uncertain and Dynamic Orienteering Problem

Published 9 Sep 2024 in eess.SY, cs.RO, and cs.SY | (2409.05545v2)

Abstract: The Orienteering Problem (OP) is a well-studied routing problem that has been extended to incorporate uncertainties, reflecting stochastic or dynamic travel costs, prize-collection costs, and prizes. Existing approaches may, however, be inefficient in real-world applications due to insufficient modeling knowledge and initially unknowable parameters in online scenarios. Thus, we propose the Uncertain and Dynamic Orienteering Problem (UDOP), modeling travel costs as distributions with unknown and time-variant parameters. UDOP also associates uncertain travel costs with dynamic prizes and prize-collection costs for its objective and budget constraints. To address UDOP, we develop an ADaptive Approach for Probabilistic paThs - ADAPT, that iteratively performs 'execution' and 'online planning' based on an initial 'offline' solution. The execution phase updates system status and records online cost observations. The online planner employs a Bayesian approach to adaptively estimate power consumption and optimize path sequence based on safety beliefs. We evaluate ADAPT in a practical Unmanned Aerial Vehicle (UAV) charging scheduling problem for Wireless Rechargeable Sensor Networks. The UAV must optimize its path to recharge sensor nodes efficiently while managing its energy under uncertain conditions. ADAPT maintains comparable solution quality and computation time while offering superior robustness. Extensive simulations show that ADAPT achieves a 100% Mission Success Rate (MSR) across all tested scenarios, outperforming comparable heuristic-based and frequentist approaches that fail up to 70% (under challenging conditions) and averaging 67% MSR, respectively. This work advances the field of OP with uncertainties, offering a reliable and efficient approach for real-world applications in uncertain and dynamic environments.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. A. Gunawan, H. C. Lau, and P. Vansteenwegen, “Orienteering problem: A survey of recent variants, solution approaches and applications,” European Journal of Operational Research, vol. 255, no. 2, pp. 315–332, 2016.
  2. J. Wang, J. Guo, M. Zheng, Z. MuRong, and Z. Li, “Research on a novel minimum-risk model for uncertain orienteering problem based on uncertainty theory,” Soft Computing, vol. 23, pp. 4573–4584, 2019.
  3. E. Angelelli, C. Archetti, C. Filippi, and M. Vindigni, “A dynamic and probabilistic orienteering problem,” Computers & Operations Research, vol. 136, p. 105454, 2021.
  4. T. C. Thayer and S. Carpin, “An adaptive method for the stochastic orienteering problem,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 4185–4192, 2021.
  5. B. H. O. Rios, E. C. Xavier, F. K. Miyazawa, P. Amorim, E. Curcio, and M. J. Santos, “Recent dynamic vehicle routing problems: A survey,” Computers & Industrial Engineering, vol. 160, p. 107604, 2021.
  6. M. Li, L. Liu, Y. Gu, Y. Ding, and L. Wang, “Minimizing energy consumption in wireless rechargeable uav networks,” IEEE Internet of Things Journal, vol. 9, no. 5, pp. 3522–3532, 2022.
  7. Q. Qian, A. Y. Pandiyan, and D. E. Boyle, “Optimal recharge scheduler for drone-to-sensor wireless power transfer,” IEEE Access, vol. 9, pp. 59 301–59 312, 2021.
  8. Y. Wang and D. Boyle, “Constrained reinforcement learning using distributional representation for trustworthy quadrotor uav tracking control,” IEEE Transactions on Automation Science and Engineering, pp. 1–18, 2024.
  9. P. Abichandani, D. Lobo, G. Ford, D. Bucci, and M. Kam, “Wind measurement and simulation techniques in multi-rotor small unmanned aerial vehicles,” IEEE Access, vol. 8, pp. 54 910–54 927, 2020.
  10. C. Rotaru and M. Todorov, “Helicopter flight physics,” Flight Physics-Models, Techniques and Technologies, vol. 10, p. 1948, 2018.
  11. Y. Chen, D. Baek, A. Bocca, A. Macii, E. Macii, and M. Poncino, “A case for a battery-aware model of drone energy consumption,” in 2018 IEEE international telecommunications energy conference (INTELEC).   IEEE, 2018, pp. 1–8.
  12. J. Shi, P. Cong, L. Zhao, X. Wang, S. Wan, and M. Guizani, “A two-stage strategy for uav-enabled wireless power transfer in unknown environments,” IEEE Transactions on Mobile Computing, vol. 23, no. 2, pp. 1785–1802, 2024.
  13. C. Lin, W. Yang, H. Dai, T. Li, Y. Wang, L. Wang, G. Wu, and Q. Zhang, “Near optimal charging schedule for 3-d wireless rechargeable sensor networks,” IEEE Transactions on Mobile Computing, vol. 22, no. 6, pp. 3525–3540, 2023.
  14. Y. Liu, H. Pan, G. Sun, A. Wang, J. Li, and S. Liang, “Joint scheduling and trajectory optimization of charging uav in wireless rechargeable sensor networks,” IEEE Internet of Things Journal, vol. 9, no. 14, pp. 11 796–11 813, 2022.
  15. J. Pasha, Z. Elmi, S. Purkayastha, A. M. Fathollahi-Fard, Y.-E. Ge, Y.-Y. Lau, and M. A. Dulebenets, “The drone scheduling problem: A systematic state-of-the-art review,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 9, pp. 14 224–14 247, 2022.
  16. A. M. Campbell, M. Gendreau, and B. W. Thomas, “The orienteering problem with stochastic travel and service times,” Annals of Operations Research, vol. 186, no. 1, pp. 61–81, 2011.
  17. H. C. Lau, W. Yeoh, P. Varakantham, D. T. Nguyen, and H. Chen, “Dynamic stochastic orienteering problems for risk-aware applications,” in Proceedings of the Twenty-Eighth Conference on Uncertainty in Artificial Intelligence, ser. UAI’12.   Arlington, Virginia, USA: AUAI Press, 2012, p. 448–458.
  18. N. Liu, J. Zhang, C. Luo, J. Cao, Y. Hong, Z. Chen, and T. Chen, “Dynamic charging strategy optimization for uav-assisted wireless rechargeable sensor networks based on deep q-network,” IEEE Internet of Things Journal, vol. 11, no. 12, pp. 21 125–21 134, 2024.
  19. P. Xue, X. Li, Z. Jiang, B. Luo, Y. Miao, X. Liu, and R. H. Deng, “A multi-cuav multi-uav electricity scheduling scheme: From charging location selection to electricity transaction,” IEEE Internet of Things Journal, vol. 10, no. 23, pp. 20 899–20 913, 2023.
  20. H. Yang, R. Ruby, Q.-V. Pham, and K. Wu, “Aiding a disaster spot via multi-uav-based iot networks: Energy and mission completion time-aware trajectory optimization,” IEEE Internet of Things Journal, vol. 9, no. 8, pp. 5853–5867, 2022.
  21. L. Evers, T. Dollevoet, A. I. Barros, and H. Monsuur, “Robust UAV mission planning,” Annals of Operations Research, vol. 222, pp. 293–315, 2014.
  22. J. Zhang, J. F. Campbell, D. C. Sweeney II, and A. C. Hupman, “Energy consumption models for delivery drones: A comparison and assessment,” Transportation Research Part D: Transport and Environment, vol. 90, p. 102668, 2021.
  23. Q. Qian, J. O’Keeffe, Y. Wang, and D. Boyle, “Practical mission planning for optimized uav-sensor wireless recharging,” arXiv preprint arXiv:2203.04595, 2022.
  24. T. A. Rodrigues, J. Patrikar, N. L. Oliveira, H. S. Matthews, S. Scherer, and C. Samaras, “Drone flight data reveal energy and greenhouse gas emissions savings for very small package delivery,” Patterns, vol. 3, no. 8, 2022.
  25. X. T. P. She, X. Lin, and H. Lang, “A data-driven power consumption model for electric uavs,” in 2020 American Control Conference (ACC), 2020, pp. 4957–4962.
  26. R. Alyassi, M. Khonji, A. Karapetyan, S. C.-K. Chau, K. Elbassioni, and C.-M. Tseng, “Autonomous recharging and flight mission planning for battery-operated autonomous drones,” IEEE Transactions on Automation Science and Engineering, vol. 20, no. 2, pp. 1034–1046, 2022.
  27. T. A. Rodrigues, J. Patrikar, A. Choudhry, J. Feldgoise, V. Arcot, A. Gahlaut, S. Lau, B. Moon, B. Wagner, H. S. Matthews et al., “In-flight positional and energy use data set of a dji matrice 100 quadcopter for small package delivery,” Scientific Data, vol. 8, no. 1, p. 155, 2021.
  28. J. M. Arteaga, J. Sanchez, F. Elsakloul, M. Marin, C. Zesiger, N. Pucci, G. J. Norton, D. J. Young, D. E. Boyle, E. M. Yeatman et al., “High frequency inductive power transfer through soil for agricultural applications,” IEEE transactions on power electronics, 2023.
  29. T. Polonelli, Y. Qin, E. M. Yeatman, L. Benini, and D. Boyle, “A flexible, low-power platform for UAV-based data collection from remote sensors,” IEEE Access, vol. 8, pp. 164 775–164 785, 2020.
  30. M. Dorigo and L. M. Gambardella, “Ant colony system: a cooperative learning approach to the traveling salesman problem,” IEEE Transactions on evolutionary computation, vol. 1, no. 1, pp. 53–66, 1997.
  31. A. K. Mandal and S. Dehuri, “A survey on ant colony optimization for solving some of the selected np-hard problem,” in Biologically Inspired Techniques in Many-Criteria Decision Making: International Conference on Biologically Inspired Techniques in Many-Criteria Decision Making (BITMDM-2019).   Springer, 2020, pp. 85–100.
  32. Gurobi Optimization, LLC, “Gurobi Optimizer Reference Manual,” 2024. [Online]. Available: https://www.gurobi.com
  33. A. Friebe, F. Markovic, A. V. Papadopoulos, and T. Nolte, “Adaptive runtime estimate of task execution times using bayesian modeling,” in 27th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2021, Houston, TX, USA, August 18-20, 2021.   IEEE, 2021, pp. 1–10.
  34. A. C. Turlapaty, “Variational bayesian estimation of statistical properties of composite gamma log-normal distribution,” IEEE Trans. Signal Process., vol. 68, pp. 6481–6492, 2020.
  35. K. P. Murphy, “Conjugate bayesian analysis of the gaussian distribution,” def, vol. 1, no. 2σ𝜎\sigmaitalic_σ2, p. 16, 2007.
  36. H. Kim, D. Lim, and K. Yee, “Flight control simulation and battery performance analysis of a quadrotor under wind gust,” in 2020 International Conference on Unmanned Aircraft Systems (ICUAS).   IEEE, 2020, pp. 1782–1791.
  37. Q. Qian, Y. Wang, and D. Boyle, “On solving close enough orienteering problems with overlapped neighborhoods,” European Journal of Operational Research, vol. 318, no. 2, pp. 369–387, 2024.

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.