Disentangling Quantum and Classical Contributions in Hybrid Quantum Machine Learning Architectures (2311.05559v2)
Abstract: Quantum computing offers the potential for superior computational capabilities, particularly for data-intensive tasks. However, the current state of quantum hardware puts heavy restrictions on input size. To address this, hybrid transfer learning solutions have been developed, merging pre-trained classical models, capable of handling extensive inputs, with variational quantum circuits. Yet, it remains unclear how much each component -- classical and quantum -- contributes to the model's results. We propose a novel hybrid architecture: instead of utilizing a pre-trained network for compression, we employ an autoencoder to derive a compressed version of the input data. This compressed data is then channeled through the encoder part of the autoencoder to the quantum component. We assess our model's classification capabilities against two state-of-the-art hybrid transfer learning architectures, two purely classical architectures and one quantum architecture. Their accuracy is compared across four datasets: Banknote Authentication, Breast Cancer Wisconsin, MNIST digits, and AudioMNIST. Our research suggests that classical components significantly influence classification in hybrid transfer learning, a contribution often mistakenly ascribed to the quantum element. The performance of our model aligns with that of a variational quantum circuit using amplitude embedding, positioning it as a feasible alternative.
- Classification with Quantum Machine Learning: A Survey. arXiv:2006.12270 [quant-ph].
- SEQUENT: Towards Traceable Quantum Machine Learning using Sequential Quantum Enhanced Training. arXiv:2301.02601 [quant-ph].
- Interpreting and Explaining Deep Neural Networks for Classification of Audio Signals. arXiv:1807.03418 [cs, eess].
- Bellman, R. (1957). Dynamic Programming. Princeton University Press, Princeton, NJ.
- Variational Quantum Algorithms. Nature Reviews Physics, 3(9):625–644. arXiv:2012.09265 [quant-ph, stat].
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In International Conference on Learning Representations.
- Classification with Quantum Neural Networks on Near Term Processors. arXiv:1802.06002 [quant-ph].
- Deep Learning. MIT Press.
- Adam: A Method for Stochastic Optimization. In Bengio, Y. and LeCun, Y., editors, 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings.
- ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60(6):84–90.
- Improving Convergence for Quantum Variational Classifiers using Weight Re-Mapping. arXiv:2212.14807 [quant-ph].
- Weight Re-Mapping for Variational Quantum Algorithms. arXiv:2306.05776 [quant-ph].
- Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278–2324.
- Lohweg, V. (2013). banknote authentication. Published: UCI Machine Learning Repository.
- Transfer learning in hybrid classical-quantum neural networks. Quantum, 4:340.
- Quantum circuit learning. Physical Review A, 98(3):032309.
- Rectified Linear Units Improve Restricted Boltzmann Machines. In Proceedings of the 27th International Conference on International Conference on Machine Learning, ICML’10, pages 807–814, Madison, WI, USA. Omnipress.
- Preskill, J. (2018). Quantum Computing in the NISQ era and beyond. Quantum, 2:79. arXiv:1801.00862 [cond-mat, physics:quant-ph].
- Searching for Activation Functions. arXiv:1710.05941 [cs].
- wav2vec: Unsupervised Pre-Training for Speech Recognition. In Interspeech 2019, pages 3465–3469. ISCA.
- Evaluating analytic gradients on quantum hardware. Physical Review A, 99(3):032331.
- Circuit-centric quantum classifiers. Physical Review A, 101(3):032308. arXiv:1804.00633 [quant-ph].
- Supervised Learning with Quantum Computers. Quantum Science and Technology. Springer Cham, 1 edition.
- A Survey on Deep Transfer Learning. In Kůrková, V., Manolopoulos, Y., Hammer, B., Iliadis, L., and Maglogiannis, I., editors, Artificial Neural Networks and Machine Learning – ICANN 2018, Lecture Notes in Computer Science, pages 270–279, Cham. Springer International Publishing.
- Breast Cancer Wisconsin (Diagnostic). Published: UCI Machine Learning Repository.