Optimal Policy Synthesis from A Sequence of Goal Sets with An Application to Electric Distribution System Restoration (2404.04338v1)
Abstract: Motivated by the post-disaster distribution system restoration problem, in this paper, we study the problem of synthesizing the optimal policy for a Markov Decision Process (MDP) from a sequence of goal sets. For each goal set, our aim is to both maximize the probability to reach and minimize the expected time to reach the goal set. The order of the goal sets represents their priority. In particular, our aim is to generate a policy that is optimal with respect to the first goal set, and it is optimal with respect to the second goal set among the policies that are optimal with respect to the first goal set and so on. To synthesize such a policy, we iteratively filter the applicable actions according to the goal sets. We illustrate the developed method over sample distribution systems and disaster scenarios.
- Mdp based decision support for earthquake damaged distribution system restoration. In 2020 IEEE Power Energy Society General Meeting (PESGM), 1–5.
- Controller synthesis for probabilistic systems. In J.J. Levy, E.W. Mayr, and J.C. Mitchell (eds.), Exploring New Frontiers of Theoretical Informatics, 493–506. Springer US, Boston, MA.
- Neuro-Dynamic Programming, volume 27.
- Optimal control of markov decision processes with linear temporal logic constraints. IEEE Transactions on Automatic Control, 59(5), 1244–1257.
- A novel mdp based decision support framework to restore earthquake damaged distribution systems. In IEEE PES Innovative Smart Grid Technologies Europe (ISGT-Europe), 1–5.
- The stochastic shortest path problem: A polyhedral combinatorics perspective. European Journal of Operational Research, 285(1), 148 – 158.
- Heuristic search for generalized stochastic shortest path mdps. In Proceedings of the Twenty-First International Conference on International Conference on Automated Planning and Scheduling, ICAPS’11, 130–137. AAAI Press.
- Heuristic approach to guarantee safe solutions in probabilistic planning. In 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI), 579–585.
- Optimal policy generation for partially satisfiable co-safe ltl specifications. In Proceedings of the 24th International Conference on Artificial Intelligence, IJCAI’15, 1587–1593. AAAI Press.
- Temporal logic motion planning and control with probabilistic satisfaction guarantees. IEEE Transactions on Robotics, 28(2), 396–409.
- An Integrated Approach for Power System Restoration Planning. Proceedings of the IEEE, 105(7), 1234–1252.
- Entropy maximization for markov decision processes under temporal logic constraints. IEEE Transactions on Automatic Control, 65(4), 1552–1567.
- Seismic reliability and risk assessment of structures based on fragility analysis – a review. Advances in Structural Engineering, 18(10), 1653–1669.
- Teichteil-Königsbuch, F. (2012). Stochastic safest and shortest path problems. In Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, AAAI’12, 1825–1831. AAAI Press.
- Robust Optimization-Based Resilient Distribution Network Planning Against Natural Disasters. IEEE Transactions on Smart Grid, 7(6), 2817–2826.