Accuracy vs Memory Advantage in the Quantum Simulation of Stochastic Processes (2312.13473v2)
Abstract: Many inference scenarios rely on extracting relevant information from known data in order to make future predictions. When the underlying stochastic process satisfies certain assumptions, there is a direct mapping between its exact classical and quantum simulators, with the latter asymptotically using less memory. Here we focus on studying whether such quantum advantage persists when those assumptions are not satisfied, and the model is doomed to have imperfect accuracy. By studying the trade-off between accuracy and memory requirements, we show that quantum models can reach the same accuracy with less memory, or alternatively, better accuracy with the same memory. Finally, we discuss the implications of this result for learning tasks.
- M. Phuong and M. Hutter, Formal algorithms for transformers, arXiv preprint arXiv:2207.09238 (2022).
- J. P. Crutchfield and K. Young, Inferring statistical complexity, Physical review letters 63, 105 (1989).
- J. P. Crutchfield and D. P. Feldman, Statistical complexity of simple one-dimensional spin systems, Physical Review E 55, R1239 (1997).
- C. R. Shalizi and J. P. Crutchfield, Computational mechanics: Pattern and prediction, structure and simplicity, Journal of statistical physics 104, 817 (2001).
- C. R. Shalizi, K. L. Shalizi, and J. P. Crutchfield, An algorithm for pattern discovery in time series, arXiv preprint cs/0210025 (2002).
- T. J. Elliott, Memory compression and thermal efficiency of quantum implementations of nondeterministic hidden markov models, Physical Review A 103, 052615 (2021a).
- T. J. Elliott, Quantum coarse graining for extreme dimension reduction in modeling stochastic temporal dynamics, PRX Quantum 2, 020342 (2021b).
- L. Banchi, J. Pereira, and S. Pirandola, Generalization in quantum machine learning: A quantum information standpoint, PRX Quantum 2, 040321 (2021).
- D. P. Feldman, Computational mechanics of classical spin systems, Ph.D. thesis (1998).
- K. Murphy, Machine Learning: A Probabilistic Perspective, Adaptive Computation and Machine Learning series (MIT Press, 2012).
- N. F. Travers and J. P. Crutchfield, Equivalence of history and generator epsilon-machines, arXiv preprint arXiv:1111.4500 (2011).
- M. A. Nielsen and I. L. Chuang, Quantum computation and quantum information (Cambridge university press, 2010).
- R. Orus and G. Vidal, Infinite time-evolving block decimation algorithm beyond unitary evolution, Physical Review B 78, 155117 (2008).
- U. Schollwöck, The density-matrix renormalization group in the age of matrix product states, Annals of physics 326, 96 (2011).
- G. Vidal, Entanglement renormalization, Physical review letters 99, 220405 (2007).
- T. Kato, Perturbation theory for linear operators, Vol. 132 (Springer Science & Business Media, 2013).
- B. C. Geiger, Information-theoretic reduction of markov chains, arXiv preprint arXiv:2204.13896 (2022).
- A. Zhang and M. Wang, Spectral state compression of markov processes, IEEE transactions on information theory 66, 3202 (2019).
- H. Wu and F. Noe, Probability distance based compression of hidden markov models, Multiscale Modeling & Simulation 8, 1838 (2010).
- M. Hauru and G. Vidal, Uhlmann fidelities from tensor networks, Physical Review A 98, 042316 (2018).
- S.-H. Cha, Comprehensive survey on distance/similarity measures between probability density functions, Journal of Mathematical Models and Methods in Applied Sciences, Issue 4 (2007).
- S. Marzen and J. P. Crutchfield, Informational and causal architecture of continuous-time renewal processes, Journal of Statistical Physics 168, 109 (2017).
- S. Adhikary, S. Srinivasan, and B. Boots, Learning quantum graphical models using constrained gradient descent on the stiefel manifold, arXiv preprint arXiv:1903.03730 (2019).
- A. Hjorungnes and D. Gesbert, Complex-valued matrix differentiation: Techniques and key results, IEEE Transactions on Signal Processing 55, 2740 (2007).
- Z. Wen and W. Yin, A feasible method for optimization with orthogonality constraints, Mathematical Programming 142, 397 (2013).
- D. E. Evans and R. Høegh-Krohn, Spectral properties of positive maps on C*-algebras, Journal of the London Mathematical Society 2, 345 (1978).