Stochastic Control Barrier Functions for Economics (2312.12612v2)
Abstract: Control barrier functions (CBFs) and safety-critical control have seen a rapid increase in popularity in recent years, predominantly applied to systems in aerospace, robotics and neural network controllers. Control barrier functions can provide a computationally efficient method to monitor arbitrary primary controllers and enforce state constraints to ensure overall system safety. One area that has yet to take advantage of the benefits offered by CBFs is the field of finance and economics. This manuscript re-introduces three applications of traditional control to economics, and develops and implements CBFs for such problems. We consider the problem of optimal advertising for the deterministic and stochastic case and Merton's portfolio optimization problem. Numerical simulations are used to demonstrate the effectiveness of using traditional control solutions in tandem with CBFs and stochastic CBFs to solve such problems in the presence of state constraints.
- K. R. Muske and J. B. Rawlings, “Model predictive control with linear models,” AIChE Journal, vol. 39, no. 2, pp. 262–287, 1993.
- S. Bansal, M. Chen, S. Herbert, and C. J. Tomlin, “Hamilton-Jacobi reachability: A brief overview and recent advances,” 2017.
- E. Garone, S. Di Cairano, and I. Kolmanovsky, “Reference and command governors for systems with constraints: A survey on theory and applications,” Automatica, vol. 75, pp. 306–328, 2017.
- A. D. Ames, S. Coogan, M. Egerstedt, G. Notomista, K. Sreenath, and P. Tabuada, “Control barrier functions: Theory and applications,” in European control conference (ECC), pp. 3420–3431, IEEE, 2019.
- D. Kendrick, “Applications of Control Theory to Macroeconomics,” in Annals of Economic and Social Measurement, Volume 5, number 2, pp. 171–190, NBER, Apr. 1976.
- A. W. Phillips, “Stabilisation Policy in a Closed Economy,” The Economic Journal, vol. 64, no. 254, pp. 290–323, 1954. Publisher: [Royal Economic Society, Wiley].
- A. Dobell and Y. Ho, “Optimal investment policy: An example of a control problem in economic theory,” IEEE Transactions on Automatic Control, vol. 12, pp. 4–14, Feb. 1967.
- S. P. Sethi and G. L. Thompson, “Applications of Mathematical Control Theory to Finance: Modeling Simple Dynamic Cash Balance Problems,” The Journal of Financial and Quantitative Analysis, vol. 5, no. 4/5, pp. 381–394, 1970. Publisher: Cambridge University Press.
- S. Sethi, Optimal Control Theory: Applications to Management Science and Economics. Springer International Publishing, 2018.
- T. A. Weber, Optimal control theory with applications in economics. Cambridge, Mass: MIT Press, 2011. OCLC: ocn681535199.
- S. Sethi, “Deterministic and Stochastic Optimization of a Dynamic Advertising Model,” Optimal Control Applications and Methods, vol. 4, pp. 179–184, Apr. 1982.
- W. H. Fleming and T. Pang, “An Application of Stochastic Control Theory to Financial Economics,” SIAM Journal on Control and Optimization, vol. 43, pp. 502–531, Jan. 2004.
- E.-J. Noh and J.-H. Kim, “An optimal portfolio model with stochastic volatility and stochastic interest rate,” Journal of Mathematical Analysis and Applications, vol. 375, no. 2, pp. 510–522, 2011.
- D. Hudgins and J. Na, “H-Optimal Control for Robust Financial Asset and Input Purchasing Decisions,” Journal of Mathematical Finance, vol. 3, pp. 335–346, Aug. 2013. Number: 3 Publisher: Scientific Research Publishing.
- Cambridge, United Kingdom: Cambridge University Press, 2015.
- Berlin, Heidelberg: Springer Berlin Heidelberg, 2009.
- M. Nagumo, “Über die lage der integralkurven gewöhnlicher differentialgleichungen,” Proceedings of the Physico-Mathematical Society of Japan. 3rd Series, vol. 24, pp. 551–559, 1942.
- A. D. Ames, X. Xu, J. W. Grizzle, and P. Tabuada, “Control barrier function based quadratic programs for safety critical systems,” IEEE Transactions on Automatic Control, vol. 62, no. 8, pp. 3861–3876, 2017.
- T. Gurriet, A. Singletary, J. Reher, L. Ciarletta, E. Feron, and A. Ames, “Towards a framework for realizable safety critical control through active set invariance,” in 2018 ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS), pp. 98–106, 2018.
- S. Prajna, A. Jadbabaie, and G. J. Pappas, “A framework for worst-case and stochastic safety verification using barrier certificates,” IEEE Transactions on Automatic Control, vol. 52, no. 8, pp. 1415–1428, 2007.
- A. Clark, “Control Barrier Functions for Stochastic Systems,” Oct. 2020. arXiv:2003.03498 [math].
- B. Øksendal, Stochastic Differential Equations. Universitext, Berlin, Heidelberg: Springer Berlin Heidelberg, 2003.
- O. So, A. Clark, and C. Fan, “Almost-sure safety guarantees of stochastic zero-control barrier functions do not hold,” Dec. 2023. arXiv:2312.02430 [math].
- D. E. Kirk, Optimal Control Theory: An Introduction. Springer, 1970.
- M. L. Vidale and H. B. Wolfe, “An operations-research study of sales response to advertising,” Operations Research, vol. 5, no. 3, pp. 370–381, 1957.
- R. C. Merton, “Lifetime portfolio selection under uncertainty: The continuous-time case,” The Review of Economics and Statistics, vol. 51, no. 3, pp. 247–257, 1969.
- SciPy, “Quadratic programming solver,” Quadratic Programming Solver (Python), 2023.