Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Distributed Management of Fluctuating Energy Resources in Dynamic Networked Systems (2405.19015v1)

Published 29 May 2024 in eess.SY, cs.LG, cs.MA, and cs.SY

Abstract: Modern power systems integrate renewable distributed energy resources (DERs) as an environment-friendly enhancement to meet the ever-increasing demands. However, the inherent unreliability of renewable energy renders developing DER management algorithms imperative. We study the energy-sharing problem in a system consisting of several DERs. Each agent harvests and distributes renewable energy in its neighborhood to optimize the network's performance while minimizing energy waste. We model this problem as a bandit convex optimization problem with constraints that correspond to each node's limitations for energy production. We propose distributed decision-making policies to solve the formulated problem, where we utilize the notion of dynamic regret as the performance metric. We also include an adjustment strategy in our developed algorithm to reduce the constraint violations. Besides, we design a policy that deals with the non-stationary environment. Theoretical analysis shows the effectiveness of our proposed algorithm. Numerical experiments using a real-world dataset show superior performance of our proposal compared to state-of-the-art methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (43)
  1. W. Wei, F. Liu, and S. Mei, “Distributionally robust co-optimization of energy and reserve dispatch,” IEEE Transactions on Sustainable Energy, vol. 7, no. 1, pp. 289–300, 2015.
  2. G. Xu, W. Yu, D. Griffith, N. Golmie, and P. Moulema, “Toward integrating distributed energy resources and storage devices in smart grid,” IEEE Internet of Things journal, vol. 4, no. 1, pp. 192–204, 2016.
  3. K. Rahbar, J. Xu, and R. Zhang, “Real-time energy storage management for renewable integration in microgrid: An off-line optimization approach,” IEEE Transactions on Smart Grid, vol. 6, no. 1, pp. 124–134, 2014.
  4. D. Wu, T. Yang, A. A. Stoorvogel, and J. Stoustrup, “Distributed optimal coordination for distributed energy resources in power systems,” IEEE Transactions on Automation Science and Engineering, vol. 14, no. 2, pp. 414–424, 2016.
  5. W. Yu, D. An, D. Griffith, Q. Yang, and G. Xu, “Towards statistical modeling and machine learning based energy usage forecasting in smart grid,” ACM SIGAPP Applied Computing Review, vol. 15, no. 1, pp. 6–16, 2015.
  6. T. Wang, D. O’Neill, and H. Kamath, “Dynamic control and optimization of distributed energy resources in a microgrid,” IEEE Transactions on Smart Grid, vol. 6, no. 6, pp. 2884–2894, 2015.
  7. Y. Wang, S. Mao, and R. M. Nelms, “Online algorithm for optimal real-time energy distribution in the smart grid,” IEEE Transactions on Emerging Topics in Computing, vol. 1, no. 1, pp. 10–21, 2013.
  8. I. Atzeni, L. G. Ordóñez, G. Scutari, D. P. Palomar, and J. R. Fonollosa, “Noncooperative and cooperative optimization of distributed energy generation and storage in the demand-side of the smart grid,” IEEE Transactions on Signal Processing, vol. 61, no. 10, pp. 2454–2472, 2013.
  9. K. M. Chandy, S. H. Low, U. Topcu, and H. Xu, “A simple optimal power flow model with energy storage,” in 49th IEEE Conference on Decision and Control (CDC).   IEEE, 2010, pp. 1051–1057.
  10. Y. Zhang, N. Gatsis, and G. B. Giannakis, “Robust energy management for microgrids with high-penetration renewables,” IEEE Transactions on Sustainable Energy, vol. 4, no. 4, pp. 944–953, 2013.
  11. S. Maghsudi and M. van der Schaar, “A non-stationary bandit-learning approach to energy-efficient femto-caching with rateless-coded transmission,” IEEE Transactions on Wireless Communications, vol. 19, no. 7, pp. 5040–5056, 2020.
  12. Y. Guo, M. Pan, and Y. Fang, “Optimal power management of residential customers in the smart grid,” IEEE Transactions on Parallel and Distributed Systems, vol. 23, no. 9, pp. 1593–1606, 2012.
  13. S. Salinas, M. Li, P. Li, and Y. Fu, “Dynamic energy management for the smart grid with distributed energy resources,” IEEE Transactions on Smart Grid, vol. 4, no. 4, pp. 2139–2151, 2013.
  14. Y. Wang, S. Mao, and R. M. Nelms, “Distributed online algorithm for optimal real-time energy distribution in the smart grid,” IEEE Internet of Things Journal, vol. 1, no. 1, pp. 70–80, 2014.
  15. A. Salazar, A. Berzoy, W. Song, and J. M. Velni, “Energy management of islanded nanogrids through nonlinear optimization using stochastic dynamic programming,” IEEE Transactions on Industry Applications, vol. 56, no. 3, pp. 2129–2137, 2020.
  16. L. Ding, G. Y. Yin, W. X. Zheng, Q.-L. Han et al., “Distributed energy management for smart grids with an event-triggered communication scheme,” IEEE Transactions on Control Systems Technology, vol. 27, no. 5, pp. 1950–1961, 2018.
  17. M. S. H. Nizami, M. J. Hossain, and E. Fernandez, “Multiagent-based transactive energy management systems for residential buildings with distributed energy resources,” IEEE Transactions on Industrial Informatics, vol. 16, no. 3, pp. 1836–1847, 2019.
  18. M. Khorasany, A. Najafi-Ghalelou, and R. Razzaghi, “A framework for joint scheduling and power trading of prosumers in transactive markets,” IEEE Transactions on Sustainable Energy, vol. 12, no. 2, pp. 955–965, 2020.
  19. Y. Ye, Y. Tang, H. Wang, X.-P. Zhang, and G. Strbac, “A scalable privacy-preserving multi-agent deep reinforcement learning approach for large-scale peer-to-peer transactive energy trading,” IEEE Transactions on Smart Grid, vol. 12, no. 6, pp. 5185–5200, 2021.
  20. A.-H. Mohsenian-Rad, V. W. Wong, J. Jatskevich, R. Schober, and A. Leon-Garcia, “Autonomous demand-side management based on game-theoretic energy consumption scheduling for the future smart grid,” IEEE Transactions on Smart Grid, vol. 1, no. 3, pp. 320–331, 2010.
  21. H. K. Nguyen, H. Mohsenian-Rad, A. Khodaei, and Z. Han, “Decentralized reactive power compensation using nash bargaining solution,” IEEE Transactions on Smart Grid, vol. 8, no. 4, pp. 1679–1688, 2015.
  22. J. Wang, H. Zhong, J. Qin, W. Tang, R. Rajagopal, Q. Xia, and C. Kang, “Incentive mechanism for sharing distributed energy resources,” Journal of Modern Power Systems and Clean Energy, vol. 7, no. 4, pp. 837–850, 2019.
  23. S. Maghsudi and M. van der Schaar, “Distributed task management in cyber-physical systems: How to cooperate under uncertainty?” IEEE Transactions on Cognitive Communications and Networking, vol. 5, no. 1, pp. 165–180, 2019.
  24. Y. Wan, J. Qin, X. Yu, T. Yang, and Y. Kang, “Price-based residential demand response management in smart grids: A reinforcement learning-based approach,” IEEE/CAA Journal of Automatica Sinica, vol. 9, no. 1, pp. 123–134, 2021.
  25. M. Zinkevich, “Online convex programming and generalized infinitesimal gradient ascent,” in Proceedings of the 20th International Conference on Machine Learning (ICML-03), 2003, pp. 928–936.
  26. A. D. Flaxman, A. T. Kalai, and H. B. McMahan, “Online convex optimization in the bandit setting: gradient descent without a gradient,” 2004. [Online]. Available: https://arxiv.org/abs/cs/0408007
  27. E. Hazan and K. Levy, “Bandit convex optimization: Towards tight bounds,” Advances in Neural Information Processing Systems, vol. 27, 2014.
  28. R. Jenatton, J. Huang, and C. Archambeau, “Adaptive algorithms for online convex optimization with long-term constraints,” in International Conference on Machine Learning.   PMLR, 2016, pp. 402–411.
  29. M. Mahdavi, R. Jin, and T. Yang, “Trading regret for efficiency: online convex optimization with long term constraints,” The Journal of Machine Learning Research, vol. 13, no. 1, pp. 2503–2528, 2012.
  30. H. Yu, M. Neely, and X. Wei, “Online convex optimization with stochastic constraints,” Advances in Neural Information Processing Systems, vol. 30, 2017.
  31. J. Li, C. Gu, Z. Wu, and T. Huang, “Online learning algorithm for distributed convex optimization with time-varying coupled constraints and bandit feedback,” IEEE Transactions on Cybernetics, 2020.
  32. S. Liang, G. Yin et al., “Distributed smooth convex optimization with coupled constraints,” IEEE Transactions on Automatic Control, vol. 65, no. 1, pp. 347–353, 2019.
  33. X. Yi, X. Li, T. Yang, L. Xie, T. Chai, and K. H. Johansson, “Distributed bandit online convex optimization with time-varying coupled inequality constraints,” IEEE Transactions on Automatic Control, vol. 66, no. 10, pp. 4620–4635, 2021.
  34. P. Zhao, G. Wang, L. Zhang, and Z.-H. Zhou, “Bandit convex optimization in non-stationary environments,” The Journal of Machine Learning Research, vol. 22, no. 1, pp. 5562–5606, 2021.
  35. I. Tsetis, X. Cheng, and S. Maghsudi, “A bandit online convex optimization approach to distributed energy management in networked systems,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).   IEEE, 2023, pp. 1–5.
  36. H. Guo, X. Liu, H. Wei, and L. Ying, “Online convex optimization with hard constraints: Towards the best of two worlds and beyond,” Advances in Neural Information Processing Systems, vol. 35, pp. 36 426–36 439, 2022.
  37. “Map of new york state distributed energy resources facilities,” https://der.nyserda.ny.gov/map, accessed: 14-10-2022.
  38. S. Maghsudi and E. Hossain, “Distributed user association in energy harvesting small cell networks: An exchange economy with uncertainty,” IEEE Transactions on Green Communications and Networking, vol. 1, no. 3, pp. 294–308, 2017.
  39. J. Gama, I. Žliobaitė, A. Bifet, M. Pechenizkiy, and A. Bouchachia, “A survey on concept drift adaptation,” ACM computing surveys (CSUR), vol. 46, no. 4, pp. 1–37, 2014.
  40. P. Zhao, X. Wang, S. Xie, L. Guo, and Z.-H. Zhou, “Distribution-free one-pass learning,” IEEE Transactions on Knowledge and Data Engineering, vol. 33, no. 3, pp. 951–963, 2019.
  41. T. Van Erven and W. M. Koolen, “Metagrad: Multiple learning rates in online learning,” Advances in Neural Information Processing Systems, vol. 29, 2016.
  42. T. Chen and G. B. Giannakis, “Bandit convex optimization for scalable and dynamic IoT management,” IEEE Internet of Things Journal, vol. 6, no. 1, pp. 1276–1286, 2018.
  43. N. Andrei, “Convex functions,” Adv. Model. Optim, vol. 9, no. 2, pp. 257–267, 2007.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets