Federated Quantum Machine Learning with Differential Privacy (2310.06973v1)
Abstract: The preservation of privacy is a critical concern in the implementation of artificial intelligence on sensitive training data. There are several techniques to preserve data privacy but quantum computations are inherently more secure due to the no-cloning theorem, resulting in a most desirable computational platform on top of the potential quantum advantages. There have been prior works in protecting data privacy by Quantum Federated Learning (QFL) and Quantum Differential Privacy (QDP) studied independently. However, to the best of our knowledge, no prior work has addressed both QFL and QDP together yet. Here, we propose to combine these privacy-preserving methods and implement them on the quantum platform, so that we can achieve comprehensive protection against data leakage (QFL) and model inversion attacks (QDP). This implementation promises more efficient and secure artificial intelligence. In this paper, we present a successful implementation of these privacy-preservation methods by performing the binary classification of the Cats vs Dogs dataset. Using our quantum-classical machine learning model, we obtained a test accuracy of over 0.98, while maintaining epsilon values less than 1.3. We show that federated differentially private training is a viable privacy preservation method for quantum machine learning on Noisy Intermediate-Scale Quantum (NISQ) devices.
- “Quantum computation and quantum information,” 2010.
- “A single quantum cannot be cloned,” Nature, vol. 299, no. 5886, pp. 802–803, 1982.
- John Preskill, “Quantum computing in the nisq era and beyond,” Quantum, vol. 2, pp. 79, 2018.
- “Noisy intermediate-scale quantum algorithms,” Reviews of Modern Physics, vol. 94, no. 1, pp. 015004, 2022.
- “Quantum noise protects quantum classifiers against adversaries,” Physical Review Research, vol. 3, no. 2, pp. 023153, 2021.
- “Improved differential privacy noise mechanism in quantum machine learning,” IEEE Access, 2023.
- “Communication-efficient learning of deep networks from decentralized data,” in Artificial intelligence and statistics. PMLR, 2017, pp. 1273–1282.
- Samuel Yen-Chi Chen and Shinjae Yoo, “Federated quantum machine learning,” Entropy, vol. 23, no. 4, pp. 460, 2021.
- “The algorithmic foundations of differential privacy,” Foundations and Trends® in Theoretical Computer Science, vol. 9, no. 3–4, pp. 211–407, 2014.
- “Deep learning with differential privacy,” in Proceedings of the 2016 ACM SIGSAC conference on computer and communications security, 2016, pp. 308–318.
- “Quantum machine learning with differential privacy,” Scientific Reports, vol. 13, no. 1, pp. 2453, 2023.
- “Quantum differentially private sparse regression learning,” IEEE Transactions on Information Theory, vol. 68, no. 8, pp. 5217–5233, 2022.
- “Hardware-efficient variational quantum eigensolver for small molecules and quantum magnets,” Nature, vol. 549, no. 7671, pp. 242–246, 2017.
- “A quantum approximate optimization algorithm,” arXiv preprint arXiv:1411.4028, 2014.
- “The theory of variational hybrid quantum-classical algorithms,” New Journal of Physics, vol. 18, no. 2, pp. 023023, 2016.
- “Differential privacy amplification in quantum and quantum-inspired algorithms,” arXiv preprint arXiv:2203.03604, 2022.
- “Expressibility and entangling capability of parameterized quantum circuits for hybrid quantum-classical algorithms,” Advanced Quantum Technologies, vol. 2, no. 12, pp. 1900070, 2019.
- “Entanglement in a quantum annealing processor,” Physical Review X, vol. 4, no. 2, pp. 021041, 2014.
- “The expressive power of parameterized quantum circuits,” arXiv preprint arXiv:1810.11922, 2018.
- “The power of quantum neural networks,” Nature Computational Science, vol. 1, no. 6, pp. 403–409, 2021.
- “Generalization in quantum machine learning from few training data,” Nature communications, vol. 13, no. 1, pp. 1–11, 2022.
- “Quantum circuit learning,” Physical Review A, vol. 98, no. 3, pp. 032309, 2018.
- “Theoretical error performance analysis for variational quantum circuit based functional regression,” npj Quantum Information, vol. 9, no. 1, pp. 4, 2023.
- “An end-to-end trainable hybrid classical-quantum classifier,” Machine Learning: Science and Technology, vol. 2, no. 4, pp. 045021, 2021.
- “Quantum federated learning with quantum data,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022, pp. 8617–8621.
- “Optimizing quantum federated learning based on federated quantum natural gradient descent,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023, pp. 1–5.
- “Quantum convolutional neural networks for high energy physics data analysis,” Physical Review Research, vol. 4, no. 1, pp. 013231, 2022.
- “Variational quantum circuits for deep reinforcement learning,” IEEE Access, vol. 8, pp. 141007–141024, 2020.
- “Decentralizing feature extraction with quantum convolutional neural network for automatic speech recognition,” in ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2021, pp. 6523–6527.
- “When bert meets quantum temporal convolution learning for text classification in heterogeneous computing,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022, pp. 8602–8606.
- “The dawn of quantum natural language processing,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022, pp. 8612–8616.
- “Pqlm-multilingual decentralized portable quantum language model,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023, pp. 1–5.
- “Quantum long short-term memory,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022, pp. 8622–8626.
- C. Waites, “Pyvacy: Privacy algorithms for pytorch,” https://github.com/ChrisWaites/pyvacy, 2019.
- “Asirra: A captcha that exploits interest-aligned manual image categorization,” in Proceedings of 14th ACM Conference on Computer and Communications Security (CCS). October 2007, Association for Computing Machinery, Inc.
- “Transfer learning in hybrid classical-quantum neural networks,” Quantum, vol. 4, pp. 340, 2020.
- “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.