Machine Learning Infused Distributed Optimization for Coordinating Virtual Power Plant Assets (2310.17882v2)
Abstract: Amid the increasing interest in the deployment of Distributed Energy Resources (DERs), the Virtual Power Plant (VPP) has emerged as a pivotal tool for aggregating diverse DERs and facilitating their participation in wholesale energy markets. These VPP deployments have been fueled by the Federal Energy Regulatory Commission's Order 2222, which makes DERs and VPPs competitive across market segments. However, the diversity and decentralized nature of DERs present significant challenges to the scalable coordination of VPP assets. To address efficiency and speed bottlenecks, this paper presents a novel machine learning-assisted distributed optimization to coordinate VPP assets. Our method, named LOOP-MAC(Learning to Optimize the Optimization Process for Multi-agent Coordination), adopts a multi-agent coordination perspective where each VPP agent manages multiple DERs and utilizes neural network approximators to expedite the solution search. The LOOP-MAC method employs a gauge map to guarantee strict compliance with local constraints, effectively reducing the need for additional post-processing steps. Our results highlight the advantages of LOOP-MAC, showcasing accelerated solution times per iteration and significantly reduced convergence times. The LOOP-MAC method outperforms conventional centralized and distributed optimization methods in optimization tasks that require repetitive and sequential execution.
- Q. Wang, C. Zhang, Y. Ding, G. Xydis, J. Wang, and J. Østergaard, “Review of real-time electricity markets for integrating distributed energy resources and demand response,” Applied Energy, vol. 138, pp. 695–706, 2015.
- E. B.C. and A. Somani, “Impact of ferc order 2222 on der participation rules in us electricity markets,” tech. rep., Pacific Northwest National Laboratory, Richland, WA, 2022.
- B. Goia, T. Cioara, and I. Anghel, “Virtual power plant optimization in smart grids: A narrative review,” Future Internet, vol. 14, no. 5, p. 128, 2022.
- T. Navidi, A. El Gamal, and R. Rajagopal, “Coordinating distributed energy resources for reliability can significantly reduce future distribution grid upgrades and peak load,” Joule.
- H. Pandžić, J. M. Morales, A. J. Conejo, and I. Kuzle, “Offering model for a virtual power plant based on stochastic programming,” Applied Energy, vol. 105, pp. 282–292, 2013.
- E. Dall’Anese, S. S. Guggilam, A. Simonetto, Y. C. Chen, and S. V. Dhople, “Optimal regulation of virtual power plants,” IEEE transactions on power systems, vol. 33, no. 2, pp. 1868–1881, 2017.
- M. Vasirani, R. Kota, R. L. Cavalcante, S. Ossowski, and N. R. Jennings, “An agent-based approach to virtual power plants of wind power generators and electric vehicles,” IEEE Transactions on Smart Grid, vol. 4, no. 3, pp. 1314–1322, 2013.
- M. Mohammadi, J. Thornburg, and J. Mohammadi, “Towards an energy future with ubiquitous electric vehicles: Barriers and opportunities,” Energies, vol. 16, no. 17, p. 6379, 2023.
- M. Mohammadi and A. Mohammadi, “Empowering distributed solutions in renewable energy systems and grid optimization,” in Distributed Machine Learning and Optimization: Theory and Applications, pp. 1–17, Springer, 2023.
- N. Ruiz, I. Cobelo, and J. Oyarzabal, “A direct load control model for virtual power plant management,” IEEE Transactions on Power Systems, vol. 24, no. 2, pp. 959–966, 2009.
- A. Bagchi, L. Goel, and P. Wang, “Adequacy assessment of generating systems incorporating storage integrated virtual power plants,” IEEE Transactions on Smart Grid, vol. 10, no. 3, pp. 3440–3451, 2018.
- A. Mnatsakanyan and S. W. Kennedy, “A novel demand response model with an application for a virtual power plant,” IEEE Transactions on Smart Grid, vol. 6, no. 1, pp. 230–237, 2014.
- A. Thavlov and H. W. Bindner, “Utilization of flexible demand in a virtual power plant set-up,” IEEE Transactions on Smart Grid, vol. 6, no. 2, pp. 640–647, 2014.
- A. Cherukuri and J. Cortés, “Distributed coordination of ders with storage for dynamic economic dispatch,” IEEE transactions on automatic control, vol. 63, no. 3, pp. 835–842, 2017.
- E. G. Kardakos, C. K. Simoglou, and A. G. Bakirtzis, “Optimal offering strategy of a virtual power plant: A stochastic bi-level approach,” IEEE Transactions on Smart Grid, vol. 7, no. 2, pp. 794–806, 2015.
- M. Giuntoli and D. Poli, “Optimized thermal and electrical scheduling of a large scale virtual power plant in the presence of energy storages,” IEEE Transactions on Smart Grid, vol. 4, no. 2, pp. 942–955, 2013.
- A. G. Zamani, A. Zakariazadeh, and S. Jadid, “Day-ahead resource scheduling of a renewable energy based virtual power plant,” Applied Energy, vol. 169, pp. 324–340, 2016.
- H. Wang, Y. Jia, C. S. Lai, and K. Li, “Optimal virtual power plant operational regime under reserve uncertainty,” IEEE Transactions on Smart Grid, vol. 13, no. 4, pp. 2973–2985, 2022.
- S. Hadayeghparast, A. S. Farsangi, and H. Shayanfar, “Day-ahead stochastic multi-objective economic/emission operational scheduling of a large scale virtual power plant,” Energy, vol. 172, pp. 630–646, 2019.
- S. R. Dabbagh and M. K. Sheikh-El-Eslami, “Risk assessment of virtual power plants offering in energy and reserve markets,” IEEE Transactions on Power Systems, vol. 31, no. 5, pp. 3572–3582, 2015.
- G. Chen and J. Li, “A fully distributed admm-based dispatch approach for virtual power plant problems,” Applied Mathematical Modelling, vol. 58, pp. 300–312, 2018.
- D. K. Molzahn, F. Dörfler, H. Sandberg, S. H. Low, S. Chakrabarti, R. Baldick, and J. Lavaei, “A survey of distributed optimization and control algorithms for electric power systems,” IEEE Transactions on Smart Grid, vol. 8, no. 6, pp. 2941–2962, 2017.
- T. Yang, X. Yi, J. Wu, Y. Yuan, D. Wu, Z. Meng, Y. Hong, H. Wang, Z. Lin, and K. H. Johansson, “A survey of distributed optimization,” Annual Reviews in Control, vol. 47, pp. 278–305, 2019.
- Y. Wang, S. Wang, and L. Wu, “Distributed optimization approaches for emerging power systems operation: A review,” Electric Power Systems Research, vol. 144, pp. 127–135, 2017.
- A. H. Fitwi, D. Nagothu, Y. Chen, and E. Blasch, “A distributed agent-based framework for a constellation of drones in a military operation,” in 2019 Winter Simulation Conference (WSC), pp. 2548–2559, IEEE, 2019.
- Z. Li, Q. Guo, H. Sun, and H. Su, “Admm-based decentralized demand response method in electric vehicle virtual power plant,” in 2016 IEEE Power and Energy Society General Meeting (PESGM), pp. 1–5, IEEE, 2016.
- L. Dong, S. Fan, Z. Wang, J. Xiao, H. Zhou, Z. Li, and G. He, “An adaptive decentralized economic dispatch method for virtual power plant,” Applied Energy, vol. 300, p. 117347, 2021.
- D. E. R. T. Force, “Der integration into wholesale markets and operations,” tech. rep., Energy Systems Integration Group, Reston, VA, 2022.
- F. Darema, E. P. Blasch, S. Ravela, and A. J. Aved, “The dynamic data driven applications systems (dddas) paradigm and emerging directions,” Handbook of Dynamic Data Driven Applications Systems: Volume 2, pp. 1–51, 2023.
- E. Blasch, H. Li, Z. Ma, and Y. Weng, “The powerful use of ai in the energy sector: Intelligent forecasting,” arXiv preprint arXiv:2111.02026, 2021.
- D. Biagioni, P. Graf, X. Zhang, A. S. Zamzam, K. Baker, and J. King, “Learning-accelerated admm for distributed dc optimal power flow,” IEEE Control Systems Letters, vol. 6, pp. 1–6, 2020.
- M. Li, S. Kolouri, and J. Mohammadi, “Learning to optimize distributed optimization: Admm-based dc-opf case study,” in 2023 IEEE Power & Energy Society General Meeting (PESGM), pp. 1–5, IEEE, 2023.
- T. W. Mak, M. Chatzos, M. Tanneau, and P. Van Hentenryck, “Learning regionally decentralized ac optimal power flows with admm,” IEEE Transactions on Smart Grid, 2023.
- G. Tsaousoglou, P. Ellinas, and E. Varvarigos, “Operating peer-to-peer electricity markets under uncertainty via learning-based, distributed optimal control,” Applied Energy, vol. 343, p. 121234, 2023.
- A. Mohammadi and A. Kargarian, “Learning-aided asynchronous admm for optimal power flow,” IEEE Transactions on Power Systems, vol. 37, no. 3, pp. 1671–1681, 2021.
- W. Cui, J. Li, and B. Zhang, “Decentralized safe reinforcement learning for inverter-based voltage control,” Electric Power Systems Research, vol. 211, p. 108609, 2022.
- W. Cui, G. Shi, Y. Shi, and B. Zhang, “Leveraging predictions in power system frequency control: an adaptive approach,” arXiv e-prints, pp. arXiv–2305, 2023.
- M. Al-Saffar and P. Musilek, “Distributed optimization for distribution grids with stochastic der using multi-agent deep reinforcement learning,” IEEE access, vol. 9, pp. 63059–63072, 2021.
- M. Li, S. Kolouri, and J. Mohammadi, “Learning to solve optimization problems with hard linear constraints,” IEEE Access, 2023.
- T. Cioara, M. Antal, and C. Pop, “Deliverable d3.3-consumption flexibility models and aggregation techniques,” tech. rep., H2020 eDREAM, 2019.
- Y.-Y. Hong, J.-K. Lin, C.-P. Wu, and C.-C. Chuang, “Multi-objective air-conditioning control considering fuzzy parameters using immune clonal selection programming,” IEEE Transactions on Smart Grid, vol. 3, no. 4, pp. 1603–1610, 2012.
- Y. Wang, Z. Yang, M. Mourshed, Y. Guo, Q. Niu, and X. Zhu, “Demand side management of plug-in electric vehicles and coordinated unit commitment: A novel parallel competitive swarm optimization method,” Energy conversion and management, vol. 196, pp. 935–949, 2019.
- S. Cui, Y.-W. Wang, and J.-W. Xiao, “Peer-to-peer energy sharing among smart energy buildings by distributed transaction,” IEEE Transactions on Smart Grid, vol. 10, no. 6, pp. 6491–6501, 2019.
- N. Y. I. S. Operator, “Real-time load data for new york city’s central park,” 2023.
- B. Borlaug, F. Yang, E. Pritchard, E. Wood, and J. Gonder, “Public electric vehicle charging station utilization in the united states,” Transportation Research Part D: Transport and Environment, vol. 114, p. 103564, 2023.
- A. Standard, “Thermal environmental conditions for human occupancy,” ANSI/ASHRAE, 55, vol. 5, 1992.
- N. W. Service, “Weather data for new york city’s central park,” 2023.
- T. Stoffel and A. Andreas, “Nrel solar radiation research laboratory (srrl): Baseline measurement system (bms); golden, colorado (data),” tech. rep., National Renewable Energy Lab.(NREL), Golden, CO (United States), 1981.
- Gurobi Optimization, LLC, “Gurobi Optimizer Reference Manual.”
- H. Wang and J. Huang, “Incentivizing energy trading for interconnected microgrids,” IEEE Transactions on Smart Grid, vol. 9, no. 4, pp. 2647–2657, 2016.
- G. Li, D. Wu, J. Hu, Y. Li, M. S. Hossain, and A. Ghoneim, “Helos: Heterogeneous load scheduling for electric vehicle-integrated microgrids,” IEEE Transactions on Vehicular Technology, vol. 66, no. 7, pp. 5785–5796, 2016.