On Efficient Solutions of General Structured Markov Processes in Quantum Computational Environments (2404.17959v2)
Abstract: We study from a theoretical viewpoint the fundamental problem of efficiently computing the stationary distribution of general classes of structured Markov processes. In strong contrast with previous work, we consider this fundamental problem within the context of quantum computational environments from a mathematical perspective and devise the first quantum algorithms for computing the stationary distribution of general structured Markov processes. We derive a mathematical analysis of the computational properties of our quantum algorithms together with related theoretical results, establishing that our quantum algorithms provide the potential for significant computational improvements over that of the best-known and most-efficient classical algorithms in various settings of both theoretical and practical importance. Although motivated by general structured Markov processes, our quantum algorithms can be exploited to address a much larger class of numerical computation problems, as well as to potentially play the role of a subroutine as part of solving larger computational problems involving the stationary distribution on a quantum computer.
- S. Asmussen. Applied Probability and Queues. Springer-Verlag, Second edition, 2003.
- S. Asmussen and V. Ramaswami. Probabilistic interpretations of some duality results for the matrix paradigms in queueing theory. Communications in Statistics – Stochastic Models, 6:715–733, 1990.
- Quantum algorithms and circuits for scientific computing. Quantum Information & Computation, 16(3-4):197–236, 2016.
- Quantum machine learning. Nature, 549(7671):195–202, 2017.
- Numerical Methods for Structured Markov Chains. Oxford University Press, 2005.
- D. A. Bini and B. Meini. On cyclic reduction applied to a class of Toeplitz-like matrices arising in queueing problems. In W. J. Stewart, editor, Computations with Markov Chains: Proceedings of the 2nd International Workshop on the Numerical Solution of Markov Chains, pages 21–38. Springer, 1995.
- D. A. Bini and B. Meini. On the solution of a nonlinear matrix equation arising in queueing problems. SIAM Journal on Matrix Analysis and Applications, 17(4):906–926, 1996.
- D. A. Bini and B. Meini. Improved cyclic reduction for solving queueing problems. Numerical Algorithms, 15:57–74, 1997.
- On direct methods for solving Poisson’s equations. SIAM Journal on Numerical Analysis, 7:627–656, 1970.
- Variational quantum algorithms. Nature Reviews Physics, 3(9):625–644, 2021.
- R. H. Chan and G. Strang. Toeplitz equations by conjugate gradients with circulant preconditioner. SIAM Journal on Scientific and Statistical Computing, 10(1):104–119, 1989.
- Circulant preconditioners constructed from kernels. SIAM journal on numerical analysis, 29(4):1093–1103, 1992.
- Circulant preconditioners for toeplitz matrices with positive continuous generating functions. Mathematics of computation, 58(197):233–240, 1992.
- T. F. Chan. An optimal circulant preconditioner for toeplitz systems. SIAM journal on scientific and statistical computing, 9(4):766–771, 1988.
- Quantum-inspired algorithms from randomized numerical linear algebra. arXiv preprint arXiv:2011.04125, 2020.
- Sampling-based sublinear low-rank matrix arithmetic framework for dequantizing quantum machine learning. In Proceedings of the 52nd Annual ACM SIGACT Symposium on Theory of Computing, pages 387–400, 2020.
- Quantum linear systems algorithms: A primer. arXiv:1802.08227, 2018.
- N. Dunford and J. Schwartz. Linear Operators. Part I: General Theory (1958); Part II: Spectral Theory (1963); Part III: Spectral Operators (1971). John Wiley and Sons, New York, 1958–1971.
- Quantum singular value transformation and beyond: exponential improvements for quantum matrix arithmetics. In Proceedings of the 51st Annual ACM SIGACT Symposium on Theory of Computing, pages 193–204, 2019.
- Matrix computations. JHU press, 2013.
- D. Gottesman. An introduction to quantum error correction and fault-tolerant quantum computation. In Quantum information science and its contributions to mathematics, Proceedings of Symposia in Applied Mathematics, volume 68, pages 13–58, 2010.
- L. K. Grover. A fast quantum mechanical algorithm for database search. In Proceedings of the twenty-eighth annual ACM symposium on Theory of computing, pages 212–219, 1996.
- N. J. Higham. Accuracy and Stability of Numerical Algorithms. SIAM, second edition, 2002.
- Quasi-birth-and-death processes, lattice path counting, and hypergeometric functions. Journal of Applied Probability, 46(2):507–520, 2009.
- J. Leeuwaarden and E. Winands. Quasi-birth-and-death processes with an explicit rate matrix. Stochastic Models, 22:77–98, 2006.
- J. Li and S. Kais. A universal quantum circuit design for periodical functions. New Journal of Physics, 23, 2021.
- J. Li and S. Kais. A universal quantum circuit design for periodical functions. New Journal of Physics, 23(10):103022, 2021.
- L. Lin. Lecture Notes on Quantum Algorithms for Scientific Computation. University of California at Berkeley, March 2022.
- Introduction to Quantum Algorithms via Linear Algebra. MIT Press, second edition, 2021.
- D. Liu and Y. Zhao. Determination of explicit solutions for a general class of Markov processes. In Matrix-Analytic Methods in Stochastic Models, pages 343–357, 1997.
- R. Nelson and M. Squillante. Stochastic analysis of affinity scheduling and load balancing in parallel processing systems. In INFORMS Computer Science Technical Section Conference on Computer Science and Operations Research: Recent Advances in the Interface. 1996.
- M. Neuts. Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach. 1981.
- M. Neuts. Structured Stochastic Matrices of M/G/1 Type and Their Applications. Marcel Dekker, 1989.
- Quantum computation and quantum information. Phys. Today, 54(2):60, 2001.
- Quantum Computation and Quantum Information. Cambridge University Press, 2010.
- A variational eigenvalue solver on a photonic quantum processor. Nature communications, 5(1):1–7, 2014.
- R. Portugal. Quantum Walks and Search Algorithms. Second edition, 2018.
- V. Ramaswami. A duality theorem for the matrix paradigms in queueing theory. Communications in Statistics – Stochastic Models, 6:151–161, 1990.
- V. Ramaswami and G. Latouche. A general class of Markov processes with explicit matrix-geometric solutions. OR Spektrum, 8:209–218, 1986.
- Quantum support vector machine for big data classification. Physical review letters, 113(13):130503, 2014.
- M. Schuld and N. Killoran. Quantum machine learning in feature Hilbert spaces. Physical review letters, 122(4):040504, 2019.
- An introduction to quantum machine learning. Contemporary Physics, 56(2):172–185, 2015.
- S. Serra. The extension of the concept of the generating function to a class of preconditioned toeplitz matrices. Linear algebra and its applications, 267:139–161, 1997.
- P. W. Shor. Algorithms for quantum computation: discrete logarithms and factoring. In Proceedings 35th annual symposium on foundations of computer science, pages 124–134. Ieee, 1994.
- M. Squillante. Matrix-analytic methods in stochastic parallel-server scheduling models. In Advances in Matrix Analytic Methods for Stochastic Models, pages 311–340, 1998.
- M. Squillante and R. Nelson. Analysis of task migration in shared-memory multiprocessors. In Proc. ACM SIGMETRICS Conf. Meas. Model. Comp. Sys., pages 143–155, 1991.
- Block-encoding structured matrices for data input in quantum computing. arXiv preprint arXiv:2302.10949v2, 2024.
- E. Tang. Quantum principal component analysis only achieves an exponential speedup because of its state preparation assumptions. Physical Review Letters, 127(6):060503, 2021.
- various authors. Qiskit Textbook. Github, 2023.
- Asymptotic quantum algorithm for the toeplitz systems. Physical Review A, 97(6):062322, 2018.
- A step-by-step hhl algorithm walkthrough to enhance understanding of critical quantum computing concepts. IEEE Access, 2023.
- Quantum approximate optimization algorithm: Performance, mechanism, and implementation on near-term devices. Physical Review X, 10(2):021067, 2020.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Collections
Sign up for free to add this paper to one or more collections.