A Parallelized, Adam-Based Solver for Reserve and Security Constrained AC Unit Commitment (2310.06650v2)
Abstract: Power system optimization problems which include the nonlinear AC power flow equations require powerful and robust numerical solution algorithms. Within this sub-field of nonlinear optimization, interior point methods have come to dominate the solver landscape. Over the last decade, however, a number of efficient numerical optimizers have emerged from the field of Machine Learning (ML). One algorithm in particular, Adam, has become the optimizer-of-choice for a massive percentage of ML training problems (including, e.g., the training of GPT-3), solving some of the largest unconstrained optimization problems ever conceived of. Inspired by such progress, this paper designs a parallelized Adam-based numerical solver to overcome one of the most challenging power system optimization problems: security and reserve constrained AC Unit Commitment. The resulting solver, termed QuasiGrad, recently competed in the third ARPA-E Grid Optimization (GO3) competition. In the day-ahead market clearing category (with systems ranging from 3 to 23,643 buses over 48 time periods), QuasiGrad's aggregated market surplus scores were within 5% of the winningest market surplus scores. The QuasiGrad solver is now released as an open-source Julia package: QuasiGrad.jl. The internal gradient-based solver (Adam) can easily be substituted for other ML-inspired solvers (e.g., AdaGrad, AdaDelta, RMSProp, etc.). Test results from large experiments are provided.
- I. Aravena, D. K. Molzahn et al., “Recent developments in security-constrained ac optimal power flow: Overview of challenge 1 in the arpa-e grid optimization competition,” Operations Research, 2023.
- F. Safdarian, J. Snodgrass et al., “Grid optimization competition on synthetic and industrial power systems,” in 2022 North American Power Symposium (NAPS), 2022, pp. 1–6.
- J. Holzer, C. Coffrin et al., “Grid optimization competition challenge 2 problem formulation,” https://gocompetition.energy.gov/sites/default/files/Challenge2_Problem_Formulation_20210531.pdf.
- H. Hijazi, G. Wang, and C. Coffrin, “Gravity: A mathematical modeling language for optimization and machine learning,” 2018.
- T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al., “Language models are few-shot learners,” Advances in neural information processing systems, vol. 33, pp. 1877–1901, 2020.
- D. Choi, C. J. Shallue, Z. Nado, J. Lee, C. J. Maddison, and G. E. Dahl, “On empirical comparisons of optimizers for deep learning,” arXiv preprint arXiv:1910.05446, 2019.
- S. Wang, H. Zhang, K. Xu, X. Lin, S. Jana, C.-J. Hsieh, and J. Zico Kolter, “Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Complete and Incomplete Neural Network Robustness Verification,” arXiv e-prints, p. arXiv:2103.06624, Mar. 2021.
- M. N. Müller, C. Brix, S. Bak, C. Liu, and T. T. Johnson, “The third international verification of neural networks competition (vnn-comp 2022): Summary and results,” 2023.
- S. Chevalier, “Quasigrad.jl,” Feb. 2024. [Online]. Available: https://github.com/SamChevalier/QuasiGrad.jl
- J. Holzer, C. Coffrin et al., “Grid optimization competition challenge 3 problem formulation,” https://gocompetition.energy.gov/sites/default/files/Challenge3_Problem_Formulation_20230126.pdf.
- S. Chevalier, “Supplementary information for a parallelized, adam-based solver for reserve and security constrained ac unit commitment,” https://samchevalier.github.io/docs/SI.pdf.
- S. Abhyankar, J. Drgoňa, A. Tuor, and A. August, “Neuro-physical dynamic load modeling using differentiable parametric optimization,” in 2023 IEEE Power & Energy Society General Meeting (PESGM), 2023, pp. 1–5.
- M. R. Hestenes, E. Stiefel et al., “Methods of conjugate gradients for solving linear systems,” Journal of research of the National Bureau of Standards, vol. 49, no. 6, pp. 409–436, 1952.
- J. T. Holzer, Y. Chen, Z. Wu, F. Pan, and A. Veeramany, “Fast simultaneous feasibility test for security constrained unit commitment,” IEEE Transactions on Power Systems, pp. 1–10, 2023.
- Y. Huang, T. Ding, C. Mu, X. Zhang, Y. He, and M. Shahidehpour, “Distributed slack-bus based dc optimal power flow with transmission loss: A second-order cone programming approach and sufficient conditions,” IEEE Transactions on Automation Science and Engineering, pp. 1–13, 2023.
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
- T. McNamara, A. Pandey, A. Agarwal, and L. Pileggi, “Two-stage homotopy method to incorporate discrete control variables into ac-opf,” Electric Power Systems Research, vol. 212, p. 108283, 2022. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0378779622004722
- T. W. K. Mak, M. Chatzos, M. Tanneau, and P. V. Hentenryck, “Learning regionally decentralized ac optimal power flows with admm,” IEEE Transactions on Smart Grid, vol. 14, no. 6, pp. 4863–4876, 2023.