Non-iterative Optimization of Trajectory and Radio Resource for Aerial Network (2405.01314v2)
Abstract: We address a joint trajectory planning, user association, resource allocation, and power control problem to maximize proportional fairness in the aerial IoT network, considering practical end-to-end quality-of-service (QoS) and communication schedules. Though the problem is rather ancient, apart from the fact that the previous approaches have never considered user- and time-specific QoS, we point out a prevalent mistake in coordinate optimization approaches adopted by the majority of the literature. Coordinate optimization approaches, which repetitively optimize radio resources for a fixed trajectory and vice versa, generally converge to local optima when all variables are differentiable. However, these methods often stagnate at a non-stationary point, significantly degrading the network utility in mixed-integer problems such as joint trajectory and radio resource optimization. We detour this problem by converting the formulated problem into the Markov decision process (MDP). Exploiting the beneficial characteristics of the MDP, we design a non-iterative framework that cooperatively optimizes trajectory and radio resources without initial trajectory choice. The proposed framework can incorporate various trajectory-planning algorithms such as the genetic algorithm, tree search, and reinforcement learning. Extensive comparisons with diverse baselines verify that the proposed framework significantly outperforms the state-of-the-art method, nearly achieving the global optimum. Our implementation code is available at https://github.com/hslyu/dbspf.{https://github.com/hslyu/dbspf}.
- ITU-R WP5D, “M.2160: framework and overall objectives of the future development of IMT for 2030 and beyond,” ITU Radiocommunication Sector (ITU-R), ITU-R recommendations, Nov. 2023. [Online]. Available: https://www.itu.int/rec/R-REC-M.2160/en
- G. Karabulut Kurt, M. G. Khoshkholgh, S. Alfattani, A. Ibrahim, T. S. J. Darwish, M. S. Alam, H. Yanikomeroglu, and A. Yongacoglu, “A vision and framework for the high altitude platform station (HAPS) networks of the future,” IEEE Commun. Surveys Tuts., vol. 23, no. 2, pp. 729–779, 2021.
- 3GPP, “NR; radio resource control (RRC); protocol specification,” 3rd Generation Partnership Project (3GPP), Technical Specification (TS) 38.831, July 2023, v17.5.0.
- ——, “Solution for NR to support non-terrestrial networks,” 3rd Generation Partnership Project (3GPP), Technical Specification (TS) 38.821, April 2023, v16.2.0.
- D. Tyrovolas, P.-V. Mekikis, S. A. Tegos, P. D. Diamantoulakis, C. K. Liaskos, and G. K. Karagiannidis, “Energy-aware design of UAV-mounted RIS networks for IoT data collection,” IEEE Trans. Commun., vol. 71, no. 2, pp. 1168–1178, 2023.
- W. Jiang, B. Ai, M. Li, W. Wu, and X. Shen, “Average age-of-information minimization in aerial IRS-assisted data delivery,” IEEE Internet Things J., vol. 10, no. 17, pp. 15 133–15 146, 2023.
- H. Zhou, M. Erol-Kantarci, Y. Liu, and H. V. Poor, “A survey on model-based, heuristic, and machine learning optimization approaches in RIS-aided wireless networks,” IEEE Commun. Surveys Tuts., pp. 1–1, 2023.
- P. Tseng, “Convergence of a block coordinate descent method for nondifferentiable minimization,” J. Optim. Theory Appl., vol. 109, pp. 475–494, 01 2001.
- S. Zhang and N. Ansari, “3D drone base station placement and resource allocation with FSO-based backhaul in hotspots,” IEEE Trans. Veh. Technol., vol. 69, no. 3, pp. 3322–3329, 2020.
- S. Zeng, H. Zhang, and L. Song, “Trajectory optimization and resource allocation for multi-user OFDMA UAV relay networks,” in Proc. IEEE Global Commun. Conf. (GLOBECOM), Dec. 2019, pp. 1–6.
- S. Zeng, H. Zhang, B. Di, and L. Song, “Trajectory optimization and resource allocation for OFDMA UAV relay networks,” IEEE Trans. Wireless Commun., vol. 20, no. 10, pp. 6634–6647, 2021.
- C. Shen, T. Chang, J. Gong, Y. Zeng, and R. Zhang, “Multi-UAV interference coordination via joint trajectory and power control,” IEEE Trans. Signal Processing, vol. 68, pp. 843–858, 2020.
- O. Abbasi, H. Yanikomeroglu, A. Ebrahimi, and N. M. Yamchi, “Trajectory design and power allocation for drone-assisted NR-V2X network with dynamic NOMA/OMA,” IEEE Trans. Wireless Commun., vol. 19, no. 11, pp. 7153–7168, 2020.
- H. Hu, K. Xiong, G. Qu, Q. Ni, P. Fan, and K. B. Letaief, “AoI-minimal trajectory planning and data collection in UAV-assisted wireless powered IoT networks,” IEEE Internet Things J., vol. 8, no. 2, pp. 1211–1223, 2021.
- Y. Wu, W. Yang, X. Guan, and Q. Wu, “Energy-efficient trajectory design for UAV-enabled communication under malicious jamming,” IEEE Wireless Commun. Lett., vol. 10, no. 2, pp. 206–210, 2021.
- G. Yang, R. Dai, and Y.-C. Liang, “Energy-efficient UAV backscatter communication with joint trajectory design and resource optimization,” IEEE Trans. Wireless Commun., vol. 20, no. 2, pp. 926–941, 2021.
- Y. Gao, H. Tang, B. Li, and X. Yuan, “Joint trajectory and power design for UAV-enabled secure communications with no-fly zone constraints,” IEEE Access, vol. 7, pp. 44 459–44 470, 2019.
- M. T. Nguyen and L. B. Le, “Multi-UAV trajectory control, resource allocation, and NOMA user pairing for uplink energy minimization,” IEEE Internet Things J., vol. 9, no. 23, pp. 23 728–23 740, 2022.
- W. Du, T. Wang, H. Zhang, Y. Dong, and Y. Li, “Joint resource allocation and trajectory optimization for completion time minimization for energy-constrained UAV communications,” IEEE Trans. Veh. Technol., vol. 72, no. 4, pp. 4568–4579, 2023.
- W. Lu, Y. Ding, Y. Gao, S. Hu, Y. Wu, N. Zhao, and Y. Gong, “Resource and trajectory optimization for secure communications in dual unmanned aerial vehicle mobile edge computing systems,” IEEE Trans. Ind. Inform., vol. 18, no. 4, pp. 2704–2713, 2022.
- J. Liu, Z. Xu, and Z. Wen, “Joint data transmission and trajectory optimization in UAV-enabled wireless powered mobile edge learning systems,” IEEE Trans. Veh. Technol., vol. 72, no. 9, pp. 11 617–11 630, 2023.
- H. Yang, R. Ruby, Q.-V. Pham, and K. Wu, “Aiding a disaster spot via multi-UAV-based IoT networks: Energy and mission completion time-aware trajectory optimization,” IEEE Internet Things J., vol. 9, no. 8, pp. 5853–5867, 2022.
- P. Yi, L. Zhu, L. Zhu, Z. Xiao, Z. Han, and X.-G. Xia, “Joint 3-D positioning and power allocation for UAV relay aided by geographic information,” IEEE Trans. Wireless Commun., vol. 21, no. 10, pp. 8148–8162, 2022.
- G. Zhang, Q. Wu, M. Cui, and R. Zhang, “Securing uav communications via joint trajectory and power control,” IEEE Trans. Wireless Commun., vol. 18, no. 2, pp. 1376–1389, 2019.
- M. Samir, S. Sharafeddine, C. M. Assi, T. M. Nguyen, and A. Ghrayeb, “UAV trajectory planning for data collection from time-constrained IoT devices,” IEEE Trans. Wireless Commun., vol. 19, no. 1, pp. 34–46, 2020.
- A. Al-Hilo, M. Samir, M. Elhattab, C. Assi, and S. Sharafeddine, “RIS-assisted UAV for timely data collection in IoT networks,” IEEE Systems Journal, pp. 1–12, 2022.
- Y. Zhu and S. Wang, “Efficient aerial data collection with cooperative trajectory planning for large-scale wireless sensor networks,” IEEE Trans. Commun., vol. 70, no. 1, pp. 433–444, 2022.
- C. Zhan, Y. Zeng, and R. Zhang, “Trajectory design for distributed estimation in UAV-enabled wireless sensor network,” IEEE Trans. Veh. Technol., vol. 67, no. 10, pp. 10 155–10 159, 2018.
- H. Bayerlein, P. D. Kerret, and D. Gesbert, “Trajectory optimization for autonomous flying base station via reinforcement learning,” in ’18 Proc. IEEE 19th Int. Workshop on Signal Processing Advances in Wireless Commun. (SPAWC), Aug. 2018, pp. 1–5.
- P. Tong, J. Liu, X. Wang, B. Bai, and H. Dai, “Deep reinforcement learning for efficient data collection in UAV-aided internet of things,” in Proc. IEEE Int. Conf. on Commun. Workshops (ICC Workshops), June 2020, pp. 1–6.
- C. You and R. Zhang, “3D trajectory optimization in rician fading for UAV-enabled data harvesting,” IEEE Trans. Wireless Commun., vol. 18, no. 6, pp. 3192–3207, 2019.
- B. Zhu, E. Bedeer, H. H. Nguyen, R. Barton, and J. Henry, “UAV trajectory planning in wireless sensor networks for energy consumption minimization by deep reinforcement learning,” IEEE Trans. Veh. Technol., vol. 70, no. 9, pp. 9540–9554, 2021.
- X. Liu, Y. Liu, Y. Chen, and L. Hanzo, “Trajectory design and power control for multi-UAV assisted wireless networks: A machine learning approach,” IEEE Trans. Veh. Technol., vol. 68, no. 8, pp. 7957–7969, 2019.
- A. Al-Hourani, S. Kandeepan, and S. Lardner, “Optimal LAP altitude for maximum coverage,” IEEE Commun. Lett., vol. 3, no. 6, pp. 569–572, 2014.
- J. Holis and P. Pechac, “Elevation dependent shadowing model for mobile communications via high altitude platforms in built-up areas,” IEEE Trans. Antennas Propag., vol. 56, no. 4, pp. 1078–1084, 2008.
- A. Al-Hourani, S. Kandeepan, and A. Jamalipour, “Modeling air-to-ground path loss for low altitude platforms in urban environments,” in Proc. IEEE Global Commun. Conf. (GLOBECOM), Dec. 2014, pp. 2898–2904.
- S. Burer and A. N. Letchford, “Non-convex mixed-integer nonlinear programming: A survey,” Surv. Oper. Res. Manag. Sci., vol. 17, no. 2, pp. 97–106, 2012.
- T. Weise, “Global optimization algorithms-theory and application,” Self-Published Thomas Weise, vol. 361, 2009.
- T. H. Cormen, C. E. Leiserson, R. L. Rivest, and C. Stein, “Elementary graph algorithms,” in Introduction to Algorithms, 3rd ed. The MIT Press, 2009, ch. 22, pp. 589–623.
- V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. A. Riedmiller, A. K. Fidjeland, G. Ostrovski, S. Petersen, C. Beattie, A. Sadik, I. Antonoglou, H. King, D. Kumaran, D. Wierstra, S. Legg, and D. Hassabis, “Human-level control through deep reinforcement learning,” Nature, vol. 518, pp. 529–533, 2015.
- D. W. Matolak and R. Sun, “Air–ground channel characterization for unmanned aircraft systems—part III: The suburban and near-urban environments,” IEEE Trans. Veh. Technol., vol. 66, no. 8, pp. 6607–6618, 2017.
- 3GPP, “Typical traffic characteristics of media services on 3GPP networks,” 3rd Generation Partnership Project (3GPP), Technical Specification (TS) 26.925, 04 2022, version 17.1.0.
- J. Chakareski, S. Naqvi, N. Mastronarde, J. Xu, F. Afghah, and A. Razi, “An energy efficient framework for UAV-assisted millimeter wave 5G heterogeneous cellular networks,” IEEE Trans. Green Commun. Netw., vol. 3, no. 1, pp. 37–44, 2019.
- A. Mahmood, T. X. Vu, S. Chatzinotas, and B. Ottersten, “Joint optimization of 3D placement and radio resource allocation for per-UAV sum rate maximization,” IEEE Trans. Veh. Technol., vol. 72, no. 10, pp. 13 094–13 105, 2023.
- Q. Wu, Y. Zeng, and R. Zhang, “Joint trajectory and communication design for multi-UAV enabled wireless networks,” IEEE Trans. Wireless Commun., vol. 17, no. 3, pp. 2109–2121, 2018.
- F. Ono, H. Ochiai, and R. Miura, “A wireless relay network based on unmanned aircraft system with rate optimization,” IEEE Trans. Wireless Commun., vol. 15, no. 11, pp. 7699–7708, 2016.
- T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra, “Continuous control with deep reinforcement learning,” in 4th Int. Conf. Learn. Represent., ICLR 2016, San Juan, Puerto Rico, Conf. Track Proc., May 2-4 2016.
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” in 3rd Int. Conf. on Learn. Represent., ICLR 2015, San Diego, CA, USA, Conf. Track Proc., May 7-9 2015.