Transition Role of Entangled Data in Quantum Machine Learning (2306.03481v2)
Abstract: Entanglement serves as the resource to empower quantum computing. Recent progress has highlighted its positive impact on learning quantum dynamics, wherein the integration of entanglement into quantum operations or measurements of quantum machine learning (QML) models leads to substantial reductions in training data size, surpassing a specified prediction error threshold. However, an analytical understanding of how the entanglement degree in data affects model performance remains elusive. In this study, we address this knowledge gap by establishing a quantum no-free-lunch (NFL) theorem for learning quantum dynamics using entangled data. Contrary to previous findings, we prove that the impact of entangled data on prediction error exhibits a dual effect, depending on the number of permitted measurements. With a sufficient number of measurements, increasing the entanglement of training data consistently reduces the prediction error or decreases the required size of the training data to achieve the same prediction error. Conversely, when few measurements are allowed, employing highly entangled data could lead to an increased prediction error. The achieved results provide critical guidance for designing advanced QML protocols, especially for those tailored for execution on early-stage quantum computers with limited access to quantum resources.
- Richard P Feynman. Simulating physics with computers. In Feynman and computation, pages 133–153. CRC Press, 2018.
- Peter W Shor. Polynomial-time algorithms for prime factorization and discrete logarithms on a quantum computer. SIAM review, 41(2):303–332, 1999.
- Experimental demonstration of a compiled version of shor’s algorithm with quantum entanglement. Physical Review Letters, 99(25):250505, 2007.
- Rapid solution of problems by quantum computation. Proceedings of the Royal Society of London. Series A: Mathematical and Physical Sciences, 439(1907):553–558, 1992.
- Lov K Grover. A fast quantum mechanical algorithm for database search. In Proceedings of the Twenty-eighth Annual ACM Symposium on Theory of Computing, pages 212–219. ACM, 1996.
- Quantum algorithm for linear systems of equations. Physical Review Letters, 103(15):150502, 2009.
- Quantum principal component analysis. Nature Physics, 10(9):631, 2014.
- Quantum differentially private sparse regression learning. IEEE Transactions on Information Theory, 68(8):5217–5233, 2022.
- An introduction to quantum machine learning. Contemporary Physics, 56(2):172–185, 2015.
- Quantum machine learning. Nature, 549(7671):195, 2017.
- Quantum machine learning: a classical perspective. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 474(2209):20170551, 2018.
- Machine learning & artificial intelligence in the quantum domain: a review of recent progress. Reports on Progress in Physics, 81(7):074001, 2018.
- Recent advances for quantum classifiers. Science China Physics, Mechanics & Astronomy, 65(2):220301, 2022.
- Recent advances for quantum neural networks in generative learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
- Challenges and opportunities in quantum machine learning. Nature Computational Science, 2(9):567–576, 2022.
- A variational eigenvalue solver on a photonic quantum processor. Nature Communications, 5:4213, 2014.
- Quantum optimization using variational algorithms on near-term quantum devices. Quantum Science and Technology, 3(3):030503, 2018.
- Supervised learning with quantum-enhanced feature spaces. Nature, 567(7747):209, 2019.
- The power of quantum neural networks. Nature Computational Science, 1(6):403–409, 2021.
- Power of data in quantum machine learning. Nature Communications, 12(1):1–9, 2021.
- A rigorous and robust quantum speed-up in supervised machine learning. Nature Physics, 17(9):1013–1017, 2021.
- Towards understanding the power of quantum kernels in the NISQ era. Quantum, 5:531, 2021.
- On exploring practical potentials of quantum auto-encoder with advantages. arXiv preprint arXiv:2106.15432, 2021.
- Power of quantum generative learning. arXiv preprint arXiv:2205.04730, 2022.
- Problem-dependent power of quantum neural networks on multiclass classification. Physical Review Letters, 131(14):140601, 2023.
- Information-theoretic bounds on quantum advantage in machine learning. Physical Review Letters, 126(19):190505, 2021.
- Improved quantum data analysis. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 1398–1411, 2021.
- Quantum algorithmic measurement. Nature Communications, 13(1):887, 2022.
- Exponential separations between learning with and without quantum memory. In 2021 IEEE 62nd Annual Symposium on Foundations of Computer Science (FOCS), pages 574–585. IEEE, 2022.
- Quantum advantage in learning from experiments. Science, 376(6598):1182–1186, 2022.
- Learning quantum processes without input control. arXiv preprint arXiv:2211.05005, 2022.
- What can data-centric ai learn from data and ml engineering? arXiv preprint arXiv:2112.06439, 2021.
- Data-centric artificial intelligence. Business & Information Systems Engineering, pages 1–9, 2024.
- The principles of data-centric ai. Communications of the ACM, 66(8):84–92, 2023.
- Data collection and quality challenges in deep learning: A data-centric ai perspective. The VLDB Journal, pages 1–23, 2023.
- Data-centric ai: Perspectives and challenges. In Proceedings of the 2023 SIAM International Conference on Data Mining (SDM), pages 945–948. SIAM, 2023.
- Data-centric artificial intelligence: A survey. arXiv preprint arXiv:2303.10158, 2023.
- No free lunch theorems for optimization. IEEE transactions on evolutionary computation, 1(1):67–82, 1997.
- Simple explanation of the no-free-lunch theorem and its implications. Journal of optimization theory and applications, 115:549–570, 2002.
- Michael M Wolf. Mathematical foundations of supervised learning. Lecture notes from Technical University of Munich, 2018.
- No free lunch theorem: A review. Approximation and Optimization: Algorithms, Complexity and Applications, pages 57–82, 2019.
- Language models are few-shot learners. Advances in neural information processing systems, 33:1877–1901, 2020.
- Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35:27730–27744, 2022.
- Training a helpful and harmless assistant with reinforcement learning from human feedback. arXiv preprint arXiv:2204.05862, 2022.
- Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971, 2023.
- A survey of large language models. arXiv preprint arXiv:2303.18223, 2023.
- No free lunch for quantum machine learning. arXiv preprint arXiv:2003.14103, 2020.
- Reformulation of the no-free-lunch theorem for entangled datasets. Physical Review Letters, 128(7):070501, 2022.
- Learning quantum states and unitaries of bounded gate complexity. arXiv preprint arXiv:2310.19882, 2023.
- John Preskill. Quantum computing in the nisq era and beyond. Quantum, 2:79, 2018.
- Predicting many properties of a quantum system from very few measurements. Nature Physics, 16(10):1050–1057, 2020.
- The randomized measurement toolbox. Nature Reviews Physics, 5(1):9–24, 2023.
- On the role of entanglement in quantum-computational speed-up. Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, 459(2036):2011–2032, 2003.
- The one clean qubit model without entanglement is classically simulable. arXiv preprint arXiv:1907.08224, 2019.
- Quantum-assisted quantum compiling. Quantum, 3:140, 2019.
- Henry Yuen. An improved sample complexity lower bound for (fidelity) quantum state tomography. Quantum, 7:890, 2023.
- A survey on the complexity of learning quantum states. Nature Reviews Physics, 6(1):59–69, 2024.
- All entangled states are useful for channel discrimination. Phys. Rev. Lett., 102:250501, Jun 2009.
- More entanglement implies higher performance in channel discrimination tasks. Physical Review Letters, 122(14):140404, 2019.
- Lower bounds for learning quantum states with single-copy measurements. arXiv preprint arXiv:2207.14438, 2022.
- Preparation of multiparty entangled states using pairwise perfectly efficient single-probe photon four-wave mixing. Physical Review A, 69(6):063803, 2004.
- Decay and storage of multiparticle entangled states of atoms in collective thermostat. Physical Review A, 74(4):042313, 2006.
- Preparation of entangled states of two photons in several spatial modes. Physical Review A, 77(2):023802, 2008.
- Preparation of entangled states through hilbert space engineering. Physical Review Letters, 117(14):140502, 2016.
- Minimally entangled state preparation of localized wave functions on quantum computers. Physical Review A, 102(1):012612, 2020.
- Entangled datasets for quantum machine learning. arXiv preprint arXiv:2109.03400, 2021.
- Out-of-distribution generalization for learning quantum dynamics. Nature Communications, 14(1):3751, 2023.
- The power and limitations of learning quantum dynamics incoherently. arXiv preprint arXiv:2303.12834, 2023.
- Generalization in quantum machine learning from few training data. Nature Communications, 13(1):4919, 2022.
- Optimal quantum learning of a unitary transformation. Physical Review A, 81(3):032324, 2010.
- Robust quantum compilation and circuit optimisation via energy minimisation. Quantum, 6:628, 2022.
- Variational quantum gate optimization. arXiv preprint arXiv:1810.12745, 2018.
- Variational fast forwarding for quantum simulation beyond the coherence time. npj Quantum Information, 6(1):82, 2020.
- Dynamical simulation via quantum machine learning with provable generalization. Physical Review Research, 6(1):013241, 2024.
- Learning to predict arbitrary quantum processes. PRX Quantum, 4(4):040337, 2023.
- Matthias C Caro. Learning quantum processes and hamiltonians via the pauli transfer matrix. arXiv preprint arXiv:2212.04471, 2022.
- Entanglement is necessary for optimal quantum property testing. In 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS), pages 692–703. IEEE, 2020.
- John Duchi. Lecture notes for statistics 311/electrical engineering 377. URL: https://stanford. edu/class/stats311/Lectures/full notes. pdf. Last visited on, 2:23, 2016.
- Alexander S Holevo. Probabilistic and statistical aspects of quantum theory, volume 1. Springer Science & Business Media, 2011.
- Mark M Wilde. Quantum information theory. Cambridge University Press, 2013.
- John Watrous. The theory of quantum information. Cambridge university press, 2018.
- Integration with respect to the haar measure on unitary, orthogonal and symplectic group. Communications in Mathematical Physics, 264(3):773–795, 2006.
- Symbolic integration with respect to the haar measure on the unitary group. arXiv preprint arXiv:1109.4244, 2011.
- Cost function dependent barren plateaus in shallow parametrized quantum circuits. Nature Communications, 12(1):1–12, 2021.
- David H Wolpert. The existence of a priori distinctions between learning algorithms. Neural computation, 8(7):1391–1420, 1996.
- David H Wolpert. The lack of a priori distinctions between learning algorithms. Neural computation, 8(7):1341–1390, 1996.
- Statistical complexity of quantum learning. arXiv preprint arXiv:2309.11617, 2023.
- Encoding-dependent generalization bounds for parametrized quantum circuits. Quantum, 5:582, 2021.
- Sample efficient algorithms for learning quantum channels in pac model and the approximate state discrimination problem. arXiv preprint arXiv:1810.10938, 2018.
- Generalization in quantum machine learning: A quantum information standpoint. PRX Quantum, 2(4):040321, 2021.
- Sample complexity of learning parametric quantum circuits. Quantum Science and Technology, 7(2):025014, 2022.
- Efficient measure for the expressivity of variational quantum algorithms. Physical Review Letters, 128(8):080506, 2022.
- Variational quantum algorithms for dimensionality reduction and classification. Physical Review A, 101(3):032323, 2020.
- Experimental quantum principal component analysis via parametrized quantum circuits. Physical Review Letters, 126(11):110502, 2021.
- Alexandre B. Tsybakov. Introduction to Nonparametric Estimation. Springer New York, 2009.
- Exponentially tighter bounds on limitations of quantum error mitigation. arXiv preprint arXiv:2210.11505, 2022.
- Quantum tomography via compressed sensing: error bounds, sample complexity and efficient estimators. New Journal of Physics, 14(9):095022, 2012.
- Sample-optimal tomography of quantum states. In Proceedings of the forty-eighth annual ACM symposium on Theory of Computing, pages 913–925, 2016.
- Quantum algorithms: A survey of applications and end-to-end complexities. arXiv preprint arXiv:2310.03011, 2023.
- Michel Loève. Probability theory. Courier Dover Publications, 2017.
- Barren plateaus in quantum neural network training landscapes. Nature Communications, 9(1):1–6, 2018.
- Toward trainability of deep quantum neural networks. arXiv preprint arXiv:2112.15002, 2021.
- Scott Aaronson. Shadow tomography of quantum states. In Proceedings of the 50th annual ACM SIGACT symposium on theory of computing, pages 325–338, 2018.
- Entropy inequalities. Communications in Mathematical Physics, 18(2):160–170, 1970.
- Geometry of quantum states: an introduction to quantum entanglement. Cambridge university press, 2017.
- Alexander Semenovich Holevo. Bounds for the quantity of information transmitted by a quantum communication channel. Problemy Peredachi Informatsii, 9(3):3–11, 1973.
- Quantum entanglement. Reviews of modern physics, 81(2):865, 2009.