Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Distributed Quantum Learning with co-Management in a Multi-tenant Quantum System (2312.08158v1)

Published 13 Dec 2023 in cs.DC

Abstract: The rapid advancement of quantum computing has pushed classical designs into the quantum domain, breaking physical boundaries for computing-intensive and data-hungry applications. Given its immense potential, quantum-based computing systems have attracted increasing attention with the hope that some systems may provide a quantum speedup. For example, variational quantum algorithms have been proposed for quantum neural networks to train deep learning models on qubits, achieving promising results. Existing quantum learning architectures and systems rely on single, monolithic quantum machines with abundant and stable resources, such as qubits. However, fabricating a large, monolithic quantum device is considerably more challenging than producing an array of smaller devices. In this paper, we investigate a distributed quantum system that combines multiple quantum machines into a unified system. We propose DQuLearn, which divides a quantum learning task into multiple subtasks. Each subtask can be executed distributively on individual quantum machines, with the results looping back to classical machines for subsequent training iterations. Additionally, our system supports multiple concurrent clients and dynamically manages their circuits according to the runtime status of quantum workers. Through extensive experiments, we demonstrate that DQuLearn achieves similar accuracies with significant runtime reduction, by up to 68.7% and an increase per-second circuit processing speed, by up to 3.99 times, in a 4-worker multi-tenant setting.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (35)
  1. Mnist. http://yann.lecun.com/exdb/mnist/.
  2. Qiskit: An open-source framework for quantum computing. Accessed on: Mar, 16, 2019.
  3. Pydtnn: a user-friendly and extensible framework for distributed deep learning. The Journal of Supercomputing, 77:9971–9987, 2021.
  4. T. Ben-Nun and T. Hoefler. Demystifying parallel and distributed deep learning: An in-depth concurrency analysis. ACM Computing Surveys (CSUR), 52(4):1–43, 2019.
  5. Assessing requirements to scale to practical quantum advantage. 2022.
  6. Silq: A high-level quantum language with safe uncomputation and intuitive semantics. In Proceedings of the 41st ACM SIGPLAN Conference on Programming Language Design and Implementation, pages 286–300, 2020.
  7. Tensorflow quantum: A software framework for quantum machine learning. arXiv preprint arXiv:2003.02989, 2020.
  8. C. Brunken and M. Reiher. Automated construction of quantum–classical hybrid models. Journal of Chemical Theory and Computation, 17(6):3797–3813, 2021.
  9. Distributed deep learning model for intelligent video surveillance systems with edge computing. IEEE Transactions on Industrial Informatics, 2019.
  10. Programming languages and compiler design for realistic quantum hardware. Nature, 2017.
  11. Verification of distributed quantum programs. ACM Transactions on Computational Logic, 23(3), 2022.
  12. S. Garg and G. Ramakrishnan. Advances in quantum deep learning: An overview. arXiv preprint arXiv:2005.04316, 2020.
  13. G. G. Guerreschi. Fast simulation of quantum algorithms using circuit optimization. Quantum, 6:706, 2022.
  14. Comparative performance analysis of quantum machine learning with deep learning for diabetes prediction. Complex & Intelligent Systems, 8(4):3073–3087, 2022.
  15. E. Haghighat and R. Juanes. Sciann: A keras/tensorflow wrapper for scientific computations and physics-informed deep learning using artificial neural networks. Computer Methods in Applied Mechanics and Engineering, 373:113552, 2021.
  16. Distributed quantum computing with qmpi. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, pages 1–13, 2021.
  17. Blueprint for a microwave trapped ion quantum computer. Science Advances, 3(2):e1601540, 2017.
  18. Relaxed peephole optimization: A novel compiler optimization for quantum circuits. In 2021 IEEE/ACM International Symposium on Code Generation and Optimization (CGO), pages 301–314. IEEE, 2021.
  19. Elastic resource management for deep learning applications in a container cluster. IEEE Transactions on Cloud Computing, 2022.
  20. Differentiate quality of experience scheduling for deep learning inferences with docker containers in the cloud. IEEE Transactions on Cloud Computing, 2022.
  21. J. M. Martinis. Qubit metrology for building a fault-tolerant quantum computer. npj Quantum Information, 1, 2015.
  22. R. Mayer and H.-A. Jacobsen. Scalable deep learning on distributed infrastructures: Challenges, techniques, and tools. ACM Computing Surveys (CSUR), 53(1):1–37, 2020.
  23. Iterative qubits management for quantum index searching in a hybrid system. In 2022 IEEE International Performance, Computing, and Communications Conference (IPCCC), pages 283–289. IEEE, 2022.
  24. On application of deep learning to simplified quantum-classical dynamics in electronically excited states. Machine Learning: Science and Technology, 2021.
  25. Vacsen: A visualization approach for noise awareness in quantum computing. IEEE Transactions on Visualization and Computer Graphics, 29(1):462–472, 2022.
  26. Scaling superconducting quantum computers with chiplet architectures. In 2022 55th IEEE/ACM International Symposium on Microarchitecture (MICRO), pages 1092–1109. IEEE, 2022.
  27. Qucnn: A quantum convolutional neural network with entanglement based backpropagation. In 2022 IEEE/ACM 7th Symposium on Edge Computing (SEC), pages 368–374. IEEE, 2022.
  28. Qugan: A quantum state fidelity based generative adversarial network. In 2021 IEEE International Conference on Quantum Computing and Engineering (QCE), pages 71–81. IEEE, 2021.
  29. Quclassi: A hybrid deep neural network architecture based on quantum state fidelity. Proceedings of Machine Learning and Systems, 4:251–264, 2022.
  30. A hybrid system for learning classical data in quantum states. In 2021 IEEE International Performance, Computing, and Communications Conference (IPCCC), pages 1–7. IEEE, 2021.
  31. S. Takeda and A. Furusawa. Toward large-scale fault-tolerant universal photonic quantum computing. APL Photonics, 4(6):060902, 2019.
  32. Distributed machine learning with a serverless architecture. In IEEE INFOCOM 2019-IEEE Conference on Computer Communications, pages 1288–1296. IEEE, 2019.
  33. Quantum-assisted associative adversarial network: Applying quantum annealing in deep learning. Quantum Machine Intelligence, 3:1–14, 2021.
  34. Distributed hierarchical gpu parameter server for massive scale deep learning ads systems. Proceedings of Machine Learning and Systems, 2, 2020.
  35. Black-box adversarial attacks on commercial speech platforms with minimal information. In Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security, pages 86–107, 2021.
Citations (5)

Summary

We haven't generated a summary for this paper yet.