Papers
Topics
Authors
Recent
Search
2000 character limit reached

Framework for Learning and Control in the Classical and Quantum Domains

Published 9 Jul 2023 in quant-ph | (2307.04256v2)

Abstract: Control and learning are key to technological advancement, both in the classical and quantum domains, yet their interrelationship is insufficiently clear in the literature, especially between classical and quantum definitions of control and learning. We construct a framework that formally relates learning and control, both classical and quantum, to each other, with this formalism showing how learning can aid control. Furthermore, our framework helps to identify interesting unsolved problems in the nexus of classical and quantum control and learning and help in choosing tools to solve problems. As a use case, we cast the well-studied problem of adaptive quantum-enhanced interferometric-phase estimation as a supervised learning problem for devising feasible control policies. Our unification of these fields relies on diagrammatically representing the state of knowledge, which elegantly summarizes existing knowledge and exposes knowledge gaps.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (134)
  1. R. Dorf and R. Bishop, Modern Control Systems, 11th ed. (Pearson, Boston, 2008).
  2. U. Rosolia, X. Zhang, and F. Borrelli, Data-driven predictive control for autonomous systems, Annu. Rev. Control Robot. Auton. Syst. 1, 259 (2018).
  3. T. M. Mitchell, Machine Learning, 1st ed. (McGraw-Hill, New York, 1997).
  4. S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 4th ed., Pearson Series in Artifical Intelligence (Pearson, Hoboken, 2020).
  5. T. Duriez, S. L. Brunton, and B. R. Noack, Machine Learning Control-Taming Nonlinear Dynamics and Turbulence, 1st ed., Fluid Mechanics and Its Applications (Springer, Cham, 2017).
  6. W. E, J. Han, and Q. Li, A mean-field optimal control formulation of deep learning, Res. Math. Sci. 6, 10 (2018).
  7. H. M. Wiseman and G. J. Milburn, Quantum Measurement and Control (Cambridge University Press, Cambridge, 2009).
  8. K. Jacobs, Quantum Measurement Theory and its Applications (Cambridge University Press, Cambridge, 2014).
  9. A. Hentschel and B. C. Sanders, Efficient algorithm for optimizing adaptive quantum metrology processes, Phys. Rev. Lett. 107, 233601 (2011a).
  10. S. S. Vedaie, P. Palittapongarnpim, and B. C. Sanders, Reinforcement learning for quantum metrology via quantum control, in 2018 IEEE Photonics Society Summer Topical Meeting Series (SUM) (IEEE, 2018) pp. 163–164.
  11. K.-S. Fu, Learning control systems–review and outlook, IEEE Trans. Automat. Contr. 15, 210 (1970).
  12. M. M. Wilde, Quantum Information Theory, 2nd ed. (Cambridge University Press, Cambridge, 2017).
  13. J. Borregaard and A. S. Sørensen, Near-Heisenberg-limited atomic clocks in the presence of decoherence, Phys. Rev. Lett. 111, 090801 (2013).
  14. J. N. Hollenhorst, Quantum limits on resonant-mass gravitational-radiation detectors, Phys. Rev. D 19, 1669 (1979).
  15. C. M. Caves, Quantum-mechanical noise in an interferometer, Phys. Rev. D 23, 1693 (1981).
  16. M. Mohri, A. Rostamizadeh, and A. Talwalkar, Foundations of Machine Learning, 2nd ed., Adaptive Computation And Machine Learning series (MIT press, Cambridge, 2018).
  17. W. Rudin, Principles of Mathematical Analysis, 3rd ed., International Series in Pure and Applied Mathematics (McGraw-Hill, New York, 1976).
  18. N. van Kampen, Stochastic Processes in Physics and Chemistry, 3rd ed., North-Holland Personal Library (Elsevier, Amsterdam, 2007).
  19. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, 2nd ed., Adaptive Computation and Machine Learning series (MIT Press, Cambridge, 2018).
  20. P. Domingos, A few useful things to know about machine learning, Commun. ACM 55, 78–87 (2012).
  21. P. Burman, A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods, Biometrika 76, 503 (1989).
  22. A. Dalal, M. Bagherimehrab, and B. C. Sanders, Quantum-assisted support vector regression for detecting facial landmarks (2021), arXiv:2111.09304 .
  23. M. J. Kearns and U. Vazirani, An Introduction to Computational Learning Theory (MIT Press, Cambridge, 1994).
  24. L. G. Valiant, A theory of the learnable, Commun. ACM 27, 1134–1142 (1984).
  25. L. B. Klebanov, S. T. Rachev, and F. J. Fabozzi, Robust and Non-Robust Models in Statistics (Nova Science Publishers, Hauppauge, 2009).
  26. S. Ben-David, E. Kushilevitz, and Y. Mansour, Online learning versus offline learning, Mach. Learn. 29, 45 (1997).
  27. V. Dunjko and H. J. Briegel, Machine learning & artificial intelligence in the quantum domain: a review of recent progress, Rep. Prog. Phys. 81, 074001 (2018).
  28. M. Schuld and F. Petruccione, Machine Learning with Quantum Computers, 2nd ed., Quantum Science and Technology (Springer, Cham, 2021).
  29. P. Wittek, Quantum Machine Learning: What Quantum Computing Means to Data Mining (Academic Press, New York, 2014).
  30. J. Preskill, Quantum computing and the entanglement frontier (2012), arXiv:1203.5813 .
  31. J. Preskill, Quantum computing in the NISQ era and beyond, Quantum 2, 79 (2018).
  32. A. W. Harrow and A. Montanaro, Quantum computational supremacy, Nature 549, 203 (2017).
  33. M. Schuld, I. Sinayskiy, and F. Petruccione, An introduction to quantum machine learning, Contemp. Phys. 56, 172 (2015).
  34. N. Wiebe, Key questions for the quantum machine learner to ask themselves, New J. Phys. 22, 091001 (2020).
  35. P. Rebentrost, M. Mohseni, and S. Lloyd, Quantum support vector machine for big data classification, Phys. Rev. Lett. 113, 130503 (2014).
  36. W. H. Zurek, Pointer basis of quantum apparatus: Into what mixture does the wave packet collapse?, Phys. Rev. D 24, 1516 (1981).
  37. Z.-S. Hou and Z. Wang, From model-based control to data-driven control: Survey, classification and perspective, Inf. Sci. 235, 3 (2013).
  38. I. Walmsley and H. Rabitz, Quantum physics under control, Phys. Today 56, 43 (2003).
  39. S. Lloyd, Coherent quantum feedback, Phys. Rev. A 62, 022108 (2000).
  40. A. Borzì, G. Ciaramella, and M. Sprengel, Chapter 2: Quantum Mechanics and the Schrödinger Equation, in Formulation and Numerical Solution of Quantum Control Problems, Computational Science & Engineering (Society for Industrial and Applied Mathematics, Philadelphia, 2017) pp. 7–71.
  41. E. Zahedinejad, S. Schirmer, and B. C. Sanders, Evolutionary algorithms for hard quantum control, Phys. Rev. A 90, 032310 (2014).
  42. A. E. Eiben and J. E. Smith, Introduction to Evolutionary Computing, 2nd ed., Natural Computing Series, Vol. 53 (Springer, Berlin, 2015).
  43. E. Zahedinejad, J. Ghosh, and B. C. Sanders, High-fidelity single-shot Toffoli gate via quantum control, Phys. Rev. Lett. 114, 200502 (2015).
  44. E. Zahedinejad, J. Ghosh, and B. C. Sanders, Designing high-fidelity single-shot three-qubit gates: A machine-learning approach, Phys. Rev. Appl. 6, 054005 (2016).
  45. M. Tiersch, E. J. Ganahl, and H. J. Briegel, Adaptive quantum computation in changing environments using projective simulation, Sci. Rep. 5, 12874 (2015).
  46. L. Banchi, N. Pancotti, and S. Bose, Quantum gate learning in qubit networks: Toffoli gate without time-dependent control, npj Quantum Inf. 2, 16019 (2016).
  47. M. August and X. Ni, Using recurrent neural networks to optimize dynamical decoupling for quantum memory, Phys. Rev. A 95, 012335 (2017).
  48. M. Guţă and W. Kotłowski, Quantum learning: asymptotically optimal classification of qubit states, New J. Phys. 12, 123032 (2010).
  49. S. Moe, A. M. Rustad, and K. G. Hanssen, Machine learning in control systems: an overview of the state of the art, in Artificial Intelligence XXXV, Lecture Notes in Computer Science, edited by M. Bramer and M. Petridis (Springer, Cham, 2018) pp. 250–265.
  50. Z. An and D. L. Zhou, Deep reinforcement learning for quantum gate control, EPL 126, 60002 (2019).
  51. P. Palittapongarnpim and B. C. Sanders, Robustness of quantum-enhanced adaptive phase estimation, Phys. Rev. A 100, 012106 (2019).
  52. R. Sutton, A. Barto, and R. Williams, Reinforcement learning is direct adaptive optimal control, IEEE Control Syst. 12, 19 (1992).
  53. A. Skolik, S. Jerbi, and V. Dunjko, Quantum agents in the Gym: a variational quantum algorithm for deep Q-learning, Quantum 6, 720 (2022).
  54. P. W. Bridgman, The Logic of Modern Physics, Vol. 3 (Macmillan, New York, 1927).
  55. T. Heinosaari and M. Ziman, The Mathematical Language of Quantum Theory: From Uncertainty to Entanglement (Cambridge University Press, Cambridge, 2011).
  56. F. Strocchi, An Introduction to the Mathematical Structure of Quantum Mechanics, 2nd ed., Advanced Series in Mathematical Physics, Vol. 28 (World Scientific, Singapore, 2008).
  57. L. E. Ballentine, Quantum Mechanics: A Modern Development, 2nd ed. (World Scientific, Singapore, 2014).
  58. P. L. Bowers, Lectures on Quantum Mechanics: A Primer for Mathematicians (Cambridge University Press, Cambridge, 2020).
  59. R. de la Madrid, The role of the rigged Hilbert space in quantum mechanics, Eur. J. Phys. 26, 287 (2005).
  60. M. Gadella and F. Gómez, Dirac formulation of quantum mechanics: Recent and new results, Rep. Math. Phys. 59, 127 (2007).
  61. S. T. Ali and M. Engliš, Quantization methods: A guide for physicists and analysts, Rev. Math. Phys 17, 391 (2005).
  62. K. Landsman, Foundations of Quantum Theory: From Classical Concepts to Operator Algebras, 1st ed., Fundamental Theories of Physics (Springer, Cham, 2017).
  63. V. I. Arnol’d, Mathematical Methods of Classical Mechanics, 1st ed., Graduate Texts in Mathematics, Vol. 60 (Springer, New York, 1978).
  64. A. Ashtekar and T. A. Schilling, Geometry of quantum mechanics, AIP Conf. Proc. 342, 471 (1995).
  65. A. Ashtekar and T. A. Schilling, Geometrical Formulation of Quantum Mechanics, in On Einstein’s Path: Essays in Honor of Engelbert Schucking, edited by A. Harvey (Springer, New York, 1999) pp. 23–65.
  66. D. C. Brody and L. P. Hughston, Geometric quantum mechanics, J. Geom. Phys. 38, 19 (2001).
  67. P. A. M. Dirac, The Principles of Quantum Mechanics, 4th ed., International Series of Monographs on Physics No. 27 (Oxford University Press, Oxford, 1981).
  68. B. E. Fristedt and L. F. Gray, A Modern Approach to Probability Theory, 1st ed., Probability and Its Applications (Birkhäuser, Boston, 1997).
  69. B. C. van Fraassen, Scientific Representation: Paradoxes of Perspective (Oxford University Press, Oxford, 2008).
  70. A. M. Mood, Introduction to the Theory of Statistics, 1st ed., McGraw-Hill Series in Probability and Statistics (McGraw-Hill, New York, 1950).
  71. S. M. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory, Prentice Hall Signal Processing series (Prentice Hall, Upper Saddle River, 1993).
  72. J. H. Shapiro, S. R. Shepard, and N. C. Wong, Ultimate quantum limits on phase measurement, Phys. Rev. Lett. 62, 2377 (1989).
  73. S. L. Braunstein, A. S. Lane, and C. M. Caves, Maximum-likelihood analysis of multiple quantum phase measurements, Phys. Rev. Lett. 69, 2153 (1992).
  74. A. S. Lane, S. L. Braunstein, and C. M. Caves, Maximum-likelihood statistics of multiple quantum phase measurements, Phys. Rev. A 47, 1667 (1993).
  75. V. Giovannetti, S. Lloyd, and L. Maccone, Quantum-enhanced measurements: beating the standard quantum limit, Science 306, 1330 (2004).
  76. M. Born and E. Wolf, Principles of Optics: 60th Anniversary Edition, 7th ed. (Cambridge University Press, Cambridge, 2019).
  77. B. Yurke, S. L. McCall, and J. R. Klauder, SU(2) and SU(1,1) interferometers, Phys. Rev. A 33, 4033 (1986).
  78. G. Summy and D. Pegg, Phase optimized quantum states of light, Opt. Commun. 77, 75 (1990).
  79. D. W. Berry and H. M. Wiseman, Optimal states and almost optimal adaptive measurements for quantum interferometry, Phys. Rev. Lett. 85, 5098 (2000).
  80. A. Hentschel and B. C. Sanders, Ordered measurements of permutationally-symmetric qubit strings, J. Phys. A 44, 115301 (2011b).
  81. B. C. Sanders and G. J. Milburn, Optimal quantum measurements for phase estimation, Phys. Rev. Lett. 75, 2944 (1995).
  82. H. M. Wiseman and R. B. Killip, Adaptive single-shot phase measurements: a semiclassical approach, Phys. Rev. A 56, 944 (1997).
  83. R. S. Bondurant and J. H. Shapiro, Squeezed states in phase-sensing interferometers, Phys. Rev. D 30, 2548 (1984).
  84. H. M. Wiseman, Adaptive phase measurements of optical modes: going beyond the marginal Q𝑄Qitalic_Q distribution, Phys. Rev. Lett. 75, 4587 (1995).
  85. P. Palittapongarnpim, Evolutionary Algorithm for Adaptive Quantum-Channel Control, Ph.D. thesis, University of Calgary, Canada (2019).
  86. A. Hentschel and B. C. Sanders, Machine learning for precise quantum measurement, Phys. Rev. Lett. 104, 063603 (2010).
  87. D. W. Berry, H. M. Wiseman, and J. K. Breslin, Optimal input states and feedback for interferometric phase estimation, Phys. Rev. A 63, 053804 (2001).
  88. I. Gianani, M. G. Genoni, and M. Barbieri, Assessing data postprocessing for quantum estimation, IEEE J. Sel. Top. Quantum Electron. 26, 1 (2020).
  89. Y. Peng and H. Fan, Feedback ansatz for adaptive-feedback quantum metrology training with machine learning, Phys. Rev. A 101, 022107 (2020).
  90. L. J. Fiderer, J. Schuff, and D. Braun, Neural-network heuristics for adaptive Bayesian quantum estimation, PRX Quantum 2, 020303 (2021).
  91. S. Nolan, A. Smerzi, and L. Pezzè, A machine learning approach to Bayesian parameter estimation, npj Quantum Inf. 7, 169 (2021a).
  92. S. P. Nolan, L. Pezzè, and A. Smerzi, Frequentist parameter estimation with supervised learning, AVS Quantum Sci. 3 (2021b).
  93. J. Schuff, L. J. Fiderer, and D. Braun, Improving the dynamics of quantum sensors with reinforcement learning, New J. Phys. 22, 035001 (2020).
  94. E. Knill, Conventions for quantum pseudocode (2022), arXiv:2211.02559 .
  95. S. Aaronson, D. Grier, and L. Schaeffer, The classification of reversible bit operations (2015).
  96. E. Fredkin and T. Toffoli, Conservative logic, Int. J. Theor. Phys. 21, 219 (1982).
  97. A. Bhattacharyya, On a measure of divergence between two statistical populations defined by their probability distributions, Bull. Calcutta Math. Soc. 35, 99 (1943).
  98. M. A. Nielsen and I. L. Chuang, Quantum Computation and Quantum Information: 10th Anniversary Edition (Cambridge University Press, Cambridge, 2010).
  99. C. Huyen, Designing Machine Learning Systems, 1st ed. (O’Reilly Media, Sebastopol, 2022).
  100. A. Zeguendry, Z. Jarir, and M. Quafafou, Quantum machine learning: a review and case studies, Entropy (Basel) 25 (2023).
  101. K. A. Tychola, T. Kalampokas, and G. A. Papakostas, Quantum machine learning—an overview, Electronics 12 (2023).
  102. D. Dong and I. R. Petersen, Machine Learning for Quantum Control, in Learning and Robust Control in Quantum Technology, Communications and Control Engineering (Springer, Cham, 2023) pp. 93–140.
  103. L. Pezzè, Machine learning for optical quantum metrology, Adv. Photonics 5, 020501 (2023).
  104. X. Ge, R.-B. Wu, and H. Rabitz, The optimization landscape of hybrid quantum–classical algorithms: from quantum control to NISQ applications, Annu. Rev. Control 54, 314 (2022).
  105. J. D. Martín-Guerrero and L. Lamata, Quantum machine learning: a tutorial, Neurocomputing 470, 457 (2022).
  106. D. Dong and I. R. Petersen, Quantum estimation, control and learning: opportunities and challenges, Annu. Rev. Control 54, 243 (2022).
  107. A. M. Annaswamy and A. L. Fradkov, A historical perspective of adaptive control and learning, Annu. Rev. Control 52, 18 (2021).
  108. L. Buffoni and F. Caruso, New trends in quantum machine learning, EPL 132, 60004 (2021).
  109. J. Carrasquilla, Machine learning for quantum matter, Adv. Phys.: X 5, 1797528 (2020).
  110. D. Dong and I. Petersen, Quantum control theory and applications: a survey, IET Control. Theory Appl. 4, 2651 (2010).
  111. B. Recht, A tour of reinforcement learning: the view from continuous control, Annu. Rev. Control Robot. Auton. Syst. 2, 253 (2019).
  112. C. Altafini and F. Ticozzi, Modeling and control of quantum systems: an introduction, IEEE Trans. Autom. Control 57, 1898 (2012).
  113. D. Görges, Relations between model predictive control and reinforcement learning, IFAC-PapersOnLine 50, 4920 (2017).
  114. S. Levine, Reinforcement learning and control as probabilistic inference: tutorial and review (2018), arXiv:1805.00909 .
  115. A. G. Barto, Reinforcement learning control, Curr. Opin. Neurobiol. 4, 888 (1994).
  116. X. Ouvrard, Hypergraphs: an introduction and review (2020), arXiv:2002.05014 .
  117. N. Wiebe, D. Braun, and S. Lloyd, Quantum algorithm for data fitting, Phys. Rev. Lett. 109, 050505 (2012).
  118. W. M. Watkins, S. Y.-C. Chen, and S. Yoo, Quantum machine learning with differential privacy, Sci. Rep. 13, 2453 (2023).
  119. G. Verdon, J. Pye, and M. Broughton, A universal training algorithm for quantum deep learning (2018), arXiv:1806.09729 .
  120. N. Wiebe, A. Kapoor, and K. M. Svore, Quantum deep learning (2015), arXiv:1412.3489 .
  121. M. Kashif and S. Al-kuwari, ResQNets: A residual approach for mitigating barren plateaus in quantum neural networks (2023), arXiv:2305.03527 .
  122. S. Lu, L.-M. Duan, and D.-L. Deng, Quantum adversarial machine learning, Phys. Rev. Res. 2, 033212 (2020).
  123. V. Dunjko, J. M. Taylor, and H. J. Briegel, Quantum-enhanced machine learning, Phys. Rev. Lett. 117, 130501 (2016).
  124. B. Pokharel and D. A. Lidar, Demonstration of algorithmic quantum speedup, Phys. Rev. Lett. 130, 210602 (2023).
  125. Y. Liu, S. Arunachalam, and K. Temme, A rigorous and robust quantum speed-up in supervised machine learning, Nat. Phys. 17, 1013 (2021b).
  126. N. Liu and P. Rebentrost, Quantum machine learning for quantum anomaly detection, Phys. Rev. A 97, 042315 (2018).
  127. M. Schuld and N. Killoran, Quantum machine learning in feature Hilbert spaces, Phys. Rev. Lett. 122, 040504 (2019).
  128. S. Arunachalam and R. de Wolf, Guest column: a survey of quantum learning theory, SIGACT News 48, 41–67 (2017).
  129. A. Pechen and H. Rabitz, Unified analysis of terminal-time control in classical and quantum systems, EPL 91, 60005 (2010).
  130. G.-H. Liu and E. A. Theodorou, Deep learning theory review: an optimal control and dynamical systems perspective (2019), arXiv:1908.10920 .
  131. M. Jin and J. Lavaei, Stability-certified reinforcement learning: a control-theoretic perspective, IEEE Access 8, 229086 (2020).
  132. A. G. Barto, S. J. Bradtke, and S. P. Singh, Learning to act using real-time dynamic programming, Artif. Intell. 72, 81 (1995).
  133. D. Dong, Learning Control of Quantum Systems, in Encyclopedia of Systems and Control, edited by J. Baillieul and T. Samad (Springer, London, 2020) pp. 1–7.
  134. B. Q. Group, Quafu-RL: The cloud quantum computers based quantum reinforcement learning (2023), arXiv:2305.17966 .
Citations (3)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

Sign Up for Free