2000 character limit reached
Singular Control of (Reflected) Brownian Motion: A Computational Method Suitable for Queueing Applications (2312.11823v3)
Published 19 Dec 2023 in eess.SY, cs.SY, and math.OC
Abstract: Motivated by applications in queueing theory, we consider a class of singular stochastic control problems whose state space is the d-dimensional positive orthant. The original problem is approximated by a drift control problem, to which we apply a recently developed computational method that is feasible for dimensions up to d=30 or more. To show that nearly optimal solutions are obtainable using this method, we present computational results for a variety of examples, including queueing network examples that have appeared previously in the literature.
- B. Ata and S Kumar. Heavy traffic analysis of open processing networks with complete resource pooling: Asymptotic optimality of discrete review policies. The Annals of Applied Probability, 15(1A):331–391, 2005.
- Drift control of high-dimensional rbm: A computational method based on neural networks. arXiv preprint arXiv:2309.11651, 2023.
- Some solvable stochastic control problemst. Stochastics: An International Journal of Probability and Stochastic Processes, 4(1):39–83, 1980.
- A large deviations approach to asymptotically optimal control of crisscross network in heavy traffic. 2005.
- Optimal stopping and free boundary characterizations for some brownian control problems. 2008.
- Construction of asymptotically optimal control for crisscross network from a free boundary problem. Stochastic Systems, 6(2):459–518, 2017.
- Control and scheduling in a two-station queueing network: Optimal policies and heuristics. Queueing Systems, 18:301–332, 1994.
- JG Dai and J Michael Harrison. Processing networks: fluid models and stability. Cambridge University Press, 2020.
- Solving high-dimensional partial differential equations using deep learning. Proceedings of the National Academy of Sciences, 115(34):8505–8510, 2018.
- J Michael Harrison. Brownian models of queueing networks with heterogeneous customer populations. In Stochastic differential systems, stochastic control theory and applications, pages 147–186. Springer, 1988.
- J Michael Harrison. The bigstep approach to flow management in stochastic processing networks. Stochastic Networks: Theory and Applications, 4:147–186, 1996.
- J Michael Harrison. Heavy traffic analysis of a system with parallel servers: asymptotic optimality of discrete-review policies. The Annals of Applied Probability, 8(3):822–848, 1998.
- Reflected brownian motion on an orthant. The Annals of Probability, 9(2):302–308, 1981.
- Instantaneous control of brownian motion. Mathematics of Operations research, 8(3):439–453, 1983.
- Dynamic control of brownian networks: state space collapse and equivalent workload formulations. The Annals of Applied Probability, pages 747–771, 1997.
- Scheduling networks of queues: heavy traffic analysis of a simple open network. Queueing Systems, 5:265–279, 1989.
- Heavy traffic resource pooling in parallel‐server systems. Queueing Systems, 33:339–368, 1999.
- Ioannis Karatzas. A class of singular stochastic control problems. Advances in Applied Probability, 15(2):225–254, 1983.
- Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
- A numerical method for solving singular stochastic control problems. Operations Research, 52(4):563–582, 2004.
- Harold J Kushner. Numerical methods for stochastic control problems in continuous time. SIAM Journal on Control and Optimization, 28(5):999–1048, 1990.
- Numerical methods for stochastic singular control problems. SIAM journal on control and optimization, 29(6):1443–1475, 1991.
- Heavy traffic convergence of a controlled, multiclass queueing system. SIAM journal on control and optimization, 34(6):2133–2171, 1996.
- Optimal correction problem of a multidimensional stochastic system. Automatica, 25(2):223–232, 1989.
- A review of activation function for artificial neural network. In 2020 IEEE 18th World Symposium on Applied Machine Intelligence and Informatics (SAMI), pages 281–286. IEEE, 2020.
- Existence and uniqueness of semimartingale reflecting brownian motions in an orthant. Probability Theory and Related Fields, 96(3):283–317, 1993.
- Regularity of the free boundary in singular stochastic control. Journal of Differential Equations, 111:175–201, 1994.
- Yuan Zhong. Heavy-traffic near-optimality of discrete-review policies for parallel‐server systems using drift control. Manuscript in preparation, University of Chicago, 2024.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
