Dynamic Operational Planning in Warfare: A Stochastic Game Approach to Military Campaigns (2403.00607v1)
Abstract: We study a two-player discounted zero-sum stochastic game model for dynamic operational planning in military campaigns. At each stage, the players manage multiple commanders who order military actions on objectives that have an open line of control. When a battle over the control of an objective occurs, its stochastic outcome depends on the actions and the enabling support provided by the control of other objectives. Each player aims to maximize the cumulative number of objectives they control, weighted by their criticality. To solve this large-scale stochastic game, we derive properties of its Markov perfect equilibria by leveraging the logistics and military operational command and control structure. We show the consequential isotonicity of the optimal value function with respect to the partially ordered state space, which in turn leads to a significant reduction of the state and action spaces. We also accelerate Shapley's value iteration algorithm by eliminating dominated actions and investigating pure equilibria of the matrix game solved at each iteration. We demonstrate the computational value of our equilibrium results on a case study that reflects representative operational-level military campaigns with geopolitical implications. Our analysis reveals a complex interplay between the game's parameters and dynamics in equilibrium, resulting in new military insights for campaign analysts.
- Game theoretic analysis of adaptive radar jamming. IEEE Transactions on Aerospace and Electronic Systems, 47(2).
- Choosing what to protect: Strategic defensive allocation against an unknown attacker. Journal of Public Economic Theory, 9(4).
- Target Selection for Tracking in Multifunction Radar Networks: Nash and Correlated Equilibria. IEEE Transactions on Aerospace and Electronic Systems, 54(5).
- War Gamers Handbook: A Guide for Professional War Gamers. Newport, R.I., USA: U.S. Naval War College.
- Cantwell, Gregory L. 2003. Can Two Person Zero Sum Game Theory Improve Military Decision-Making Course of Action Selection. School of Advanced Military Studies, Fort Leavenworth Kansas.
- Misinformation and Disinformation in Modern Warfare. Operations Research, 70(3).
- An experimental investigation of Colonel Blotto games. Economic Theory, 52(3).
- Coughlin, P. J. 1992. Pure strategy equilibria in a class of systems defense games. International Journal of Game Theory, 20(3).
- Game-Theoretic Power Allocation and the Nash Equilibrium Analysis for a Multistatic MIMO Radar Network. IEEE Transactions on Signal Processing, 65(24).
- On the complexity of computing Markov perfect equilibrium in general-sum stochastic games. National Science Review, 10(1).
- Deterring Russian Agression in the Baltic States Through Resilience and Resistance. Tech. rept. RAND Corporation.
- Fox, William P. 2016. Applied Game Theory to Improve Strategic and Tactical Military Decisions. Journal of Defense Management, 6(2).
- Garamone, Jim. 2022. Potential for Great Power Conflict ’Increasing,’ Milley Says. https://www.defense.gov/News/News-Stories/Article/Article/2989958/potential-for-great-power-conflict-increasing-milley-says/.
- Giles, Lionel. 2013. Sun Tzu On The Art Of War. Routledge.
- Gu, Dongbing. 2011. A game theory approach to target tracking in sensor networks. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 41(1).
- Haywood, O. G. 1954. Military Decision and Game Theory. Journal of the Operations Research Society of America, 2(4), 365–385.
- Joint beamforming and power allocation between a multistatic MIMO radar network and multiple targets using game theoretic analysis. Digital Signal Processing: A Review Journal, 115.
- Headquarters, Department of the Army. 2016. Field Manual 6-0.
- Headquarters, Department of the Army. 2019. Army Regulation 71-32: Force Development and Documentation. https://armypubs.army.mil/ProductMaps/PubForm/Details.aspx?PUB_ID=1005524.
- Headquarters, Department of the Army. 2021. Chief of Staff Paper#2: The Army in Military Competition.
- Game Theory in Defence Applications: A Review. Sensors, 22(3).
- On Nonterminating Stochastic Games. Journal of Management Science, 12(5), 359–370.
- Joint Chiefs of Staff. 2016. Joint Publication 1-02: Department of Defense Dictionary of Military and Associated Terms. https://apps.dtic.mil/sti/pdfs/AD1024397.pdf.
- Joint Chiefs of Staff. 2017. Joint Publication 3-0: Joint Operations. https://www.jcs.mil/Doctrine/Joint-Doctine-Pubs.
- Joint Chiefs of Staff. 2020. Joint Publication 5-0: Joint Planning. https://www.jcs.mil/Doctrine/Joint-Doctrine-Pubs/5-0-Planning-Series/.
- Strategy, Nontransitive Dominance and the Exponential Distribution. Australian Journal of Statistics, 26(2), 111–118.
- Kharlamov, V. V. 2022. On Asymptotic Strategies in the Stochastic Colonel Blotto Game. Theory of Probability & Its Applications, 67(2), 318–326.
- Generalizations of the General Lotto and Colonel Blotto games. Economic Theory, 71(3).
- Decentralized adaptive filtering algorithms for sensor activation in an unattended ground sensor network. IEEE Transactions on Signal Processing, 56(12).
- Best-response dynamics in zero-sum stochastic games. Journal of Economic Theory, 189.
- Campaigning Perspectives Through the Lens of Joint Doctrine and Education. Campaigning: The Journal of the Joint Forces Staff College, Spring 2014.
- The U.S. Department of Defense’s Planning Process: Components and Challenges. Tech. rept. RAND Corporation.
- Stochastic game approach to air operations. IEEE Transactions on Aerospace and Electronic Systems, 40(4).
- Mueller, Karl P. 2016. Paper wargames and policy making: Filling the Baltic gap or how I learned to stop worrying and love the D6. Battles Magazine, 2016(11), 53–57.
- Algorithms for Stochastic Games with Geometrical Interpretation. Journal of Management Science, 15(7), 399–415.
- Pruitt, Sarah. 2019. The Allies Hoped Operation Market Garden Would End WWII. Here’s What Went Wrong. https://www.history.com/news/operation-market-garden-failure-allies.
- Puterman, Martin L. 2005. Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley and Sons Inc.
- Algorithms for stochastic games - A survey. ZOR Zeitschrift für Operations Research Methods and Models of Operations Research, 35(6), 437–472.
- Simulation Optimization. Pages 219–244 of: Scala, Natalie M., & Howard, James P. III (eds), Handbook of Military and Defense Operations Research. Boca Raton, FL, USA: Taylor & Francis Group.
- Shapley, L. S. 1953. Stochastic Games. Proceedings of the National Academy of Sciences, 39(10).
- Reinforcing Deterrence on NATO’s Eastern Flank: Wargaming the Defense of the Baltics. Tech. rept. RAND Corporation.
- Systems Defense Games: Colonel Blotto, Command and Control. Naval Research Logistics Quarterly, 28(2).
- Lessons from the MORS Workshop on Advancing Campaign Analytics: Challenges in Modeling Cyber Warfare, Artificial Intelligence, and Command and Control. Phalanx, 53(1), 42–48.
- The case for campaign analysis: A method for studying military operations. International Security, 45(4).
- Simulatation and Wargaming. Newark, NJ, USA: John Wiley & Sons Inc.
- Van der Wal, J. 1978. Discounted Markov games: Generalized policy iteration method. Journal of Optimization Theory and Applications, 25(1), 11–22.
- von Neumann, John. 1928. Zur Theorie der Gesellschaftsspiele. Math. Ann., 100(1).
- Fictitious play applied to sequences of games and discounted stochastic games. International Journal of Game Theory, 11(2).
- Washburn, Alan. 2014. Two-Person Zero-Sum Games. 4th edn. New York, NY: Springer U.S.