Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Deep Reinforcement Learning Approach for Improving Age of Information in Mission-Critical IoT (2311.13861v1)

Published 23 Nov 2023 in cs.NI and eess.SP

Abstract: The emerging mission-critical Internet of Things (IoT) play a vital role in remote healthcare, haptic interaction, and industrial automation, where timely delivery of status updates is crucial. The Age of Information (AoI) is an effective metric to capture and evaluate information freshness at the destination. A system design based solely on the optimization of the average AoI might not be adequate to capture the requirements of mission-critical applications, since averaging eliminates the effects of extreme events. In this paper, we introduce a Deep Reinforcement Learning (DRL)-based algorithm to improve AoI in mission-critical IoT applications. The objective is to minimize an AoI-based metric consisting of the weighted sum of the average AoI and the probability of exceeding an AoI threshold. We utilize the actor-critic method to train the algorithm to achieve optimized scheduling policy to solve the formulated problem. The performance of our proposed method is evaluated in a simulated setup and the results show a significant improvement in terms of the average AoI and the AoI violation probability compared to the related-work.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (19)
  1. Lin, W. Yu, N. Zhang, X. Yang, H. Zhang and W. Zhao, “A survey on internet of things: Architecture, enabling technologies, security and privacy, and applications,” IEEE Internet of Things J. , vol. 4, no. 5, pp. 1125-1142, Oct. 2017.
  2. H. Yang, A. Alphones, W. Zhong, C. Chen and X. Xie, “Learning-based energy-efficient resource management by heterogeneous rf/vlc for ultra-reliable low-latency industrial iot networks,” IEEE Trans. Ind. Informat., vol. 16, no. 8, pp. 5565-5576, Aug 2020.
  3. S. Kaul, R. Yates and M. Gruteser, “Real-time status: How often should one update?,” in Proc. IEEE INFOCOM 2012, Mar. 2012, pp. 2731-2735.
  4. M. K. Abdel-Aziz, C. Liu, S. Samarakoon, M. Bennis and W. Saad, “”Ultra-reliable low-latency vehicular networks: taming the age of information tail,” in Proc. IEEE Globecomm 2018, Dec. 2018, pp. 1-7.
  5. J. Sun, Z. Jiang, B. Krishnamachari, S. Zhou and Z. Niu, “Closed-form whittle’s index-enabled random access for timely status update,” IEEE Trans. Commun., vol. 68, no. 3, pp. 1538-1551, Mar. 2020.
  6. M. Moltafet, M. Leinonen and M. Codreanu, “Average aoi in multi-source systems with source-aware packet management,” IEEE Trans. Commun., vol. 69, no. 2, pp. 1121-1133, Feb. 2021.
  7. H. Hu, K. Xiong, G. Qu, Q. Ni, P. Fan and K. B. Letaief, “Aoi-minimal trajectory planning and data collection in uav-assisted wireless powered iot networks,” IEEE Internet of Things J. , vol. 8, no. 2, pp. 1211-1223, Jan. 2021.
  8. L. Hu, et el., “Optimal status update in iiot systems: An age of information violation probability perspective,” in Proc. IEEE VTC 2020, Dec. 2020, pp. 1-5.
  9. M. Akbari, M. R. Abedi, R. Joda, M. Pourghasemian, N. Mokari and M. Erol-Kantarci, “Age of information aware vnf scheduling in industrial iot using deep reinforcement learning,” IEEE J. Sel. Areas Commun., vol. 39, no. 8, pp. 2487-2500, Aug. 2021.
  10. T. Zhu, J. Li, H. Gao, Y. Li and Z. Cai, “Aoi minimization data collection scheduling for battery-free wireless sensor networks,” IEEE Trans. Mobile Comput., Early Access, Aug. 2021.
  11. I. Kadota, A. Sinha, and E. Modiano, “Scheduling algorithms for optimizing age of information in wireless networks with throughput constraints,” IEEE/ACM Trans. Netw, vol. 27, no. 4, pp. 359-1372, Aug. 2019.
  12. R. V. Bhat, R. Vaze and M. Motani, “Minimization of age of information in fading multiple access channels,” IEEE J. Sel. Areas Commun., vol. 39, no. 5, pp. 1471-1484, May 2021.
  13. C. Kam, S. Kompella, G. D. Nguyen, J. E. Wieselthier and A. Ephremides, “On the age of information with packet deadlines,” IEEE Trans. Inf. Theory, vol. 64, no. 9, pp. 6419-6428, Sept. 2018.
  14. Q. Wang, H. Chen, Y. Li, Z. Pang and B. Vucetic, “Minimizing age of information for real-time monitoring in resource-constrained industrial iot networks,” in Proc. IEEE INDIN 2019, Jul. 2019, pp. 1766-1771.
  15. M. K. Abdel-Aziz, S. Samarakoon, M. Bennis and W. Saad, “Ultra-reliable and low-latency vehicular communication: An active learning approach,” IEEE Commun. Lett., vol. 24, no. 2, pp. 367-370, Feb. 2020.
  16. V. Mnih, et el., “Asynchronous methods for deep reinforcement learning,” in Proc. ICML 2016, Jun. 2016, pp. 1928-1937.
  17. R. S. Sutton, et el., “Policy gradient methods for reinforcement learning with function approximation,” in Proc. NIPS 1999, Nov. 1999, pp. 1057-1063.
  18. A. Tan, N. Lu and D. Xiao, “Integrating temporal difference methods and self-organizing neural networks for reinforcement learning With delayed evaluative feedback,” IEEE Trans. Neural Netw., vol. 19, no. 2, pp. 230-244, Feb. 2008.
  19. Y. Ying, J. Su, P. Shan, L. Miao, X. Wang and S. Peng, “Rectified exponential units for convolutional neural networks,” IEEE Trans. Neural Netw., vol. 7, pp. 101633-101640, Jul. 2019.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Hossam Farag (13 papers)
  2. Mikael Gidlund (31 papers)
  3. Cedomir Stefanovic (66 papers)
Citations (7)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now