Solving Boltzmann Optimization Problems with Deep Learning (2401.17408v1)
Abstract: Decades of exponential scaling in high performance computing (HPC) efficiency is coming to an end. Transistor based logic in complementary metal-oxide semiconductor (CMOS) technology is approaching physical limits beyond which further miniaturization will be impossible. Future HPC efficiency gains will necessarily rely on new technologies and paradigms of compute. The Ising model shows particular promise as a future framework for highly energy efficient computation. Ising systems are able to operate at energies approaching thermodynamic limits for energy consumption of computation. Ising systems can function as both logic and memory. Thus, they have the potential to significantly reduce energy costs inherent to CMOS computing by eliminating costly data movement. The challenge in creating Ising-based hardware is in optimizing useful circuits that produce correct results on fundamentally nondeterministic hardware. The contribution of this paper is a novel machine learning approach, a combination of deep neural networks and random forests, for efficiently solving optimization problems that minimize sources of error in the Ising model. In addition, we provide a process to express a Boltzmann probability optimization problem as a supervised machine learning problem.
- Ramu Anandakrishnan. A partition function approximation using elementary symmetric functions. PLoS ONE, 7(12), 2012.
- Rodney J Baxter. Exactly solved models in statistical mechanics. Elsevier, 2016.
- Ludwig Boltzmann. On the relationship between the second fundamental theorem of the mechanical theory of heat and probability calculations regarding the conditions for thermal equilibrium. Entropy, 17(4):1971–2009, 2015.
- Faster solutions of the inverse pairwise ising problem. arXiv preprint arXiv:0712.2437, 2007.
- Unconventional computing based on magnetic tunnel junction. Applied Physics A, 129(4):236, 2023.
- Barry A. Cipra. The ising model is np-complete. SIAM News, 33(1).
- The boltzmann equation in molecular biology. Progress in biophysics and molecular biology, 99(2-3):87–93, 2009.
- Navid Anjum Aadit et al. Physics-inspired ising computing with ring oscillator activated p-bits. 2022 IEEE 22nd International Conference on Nanotechnology (NANO), pages 393–396, 2022.
- Norbert Seifert et al. Soft error susceptibilities of 22 nm tri-gate devices. In Proceedings of 2012 IEEE Nuclear and Space Radiation Effects Conference. NSREC, 2012.
- Fast doubly-adaptive mcmc to estimate the gibbs partition function with weak mixing time bounds. 34:25760–25772, 2021.
- Performance evaluation of coherent ising machines against classical neural networks. Quantum Science and Technology, 2(4):044002, 2017.
- Experimental test of landauer’s principle in single-bit operations on nanomagnetic memory bits. Science Advances, 2(3):e1501492, 2016.
- Lauren Huckaba. The ising machine—a probabilistic processing-in-memory computer. The Next Wave: The National Security Agency’s review of emerging technologies, 23(2):19–24, 2022. ISSN 2640-1789, 2640-1797.
- Deep neural network initialization with decision trees. IEEE transactions on neural networks and learning systems, 30(5):1286–1295, 2018.
- Dieter Kraft. A software package for sequential quadratic programming. Forschungsbericht- Deutsche Forschungs- und Versuchsanstalt fur Luft- und Raumfahrt, 1988.
- Breiman Leou. Random forests. Machine Learning, 45:5–32, 2001.
- Design of general purpose minimal-auxiliary ising machines. In 2023 IEEE International Conference on Rebooting Computing, ICRC 2023, San Diego, CA, USA, December 5-6, 2023 (to appear). IEEE, 2023.
- Gordon E. Moore. Progress in digital integrated electronics [technical literature, copyright 1975 ieee. reprinted, with permission. technical digest. international electron devices meeting, ieee, 1975, pp. 11-13.]. IEEE Solid-State Circuits Society Newsletter, 11(3):36–37, 2006.
- Inverse statistical problems: from the inverse ising problem to data science. Advances in Physics, 66(3):197–261, 2017.
- UA Rozikov. Gibbs measures of potts model on cayley trees: a survey and applications. Reviews in Mathematical Physics, 33(10), 2021.
- The end of moore’s law: A new beginning for information technology. Computing in Science & Engineering, 19(2):41–50, 2017.
- John von Neumann. Probabilistic logics and the synthesis of reliable organisms from unreliable components. Lecture delivered at the California Institute of Technology, January, 1952.
- Quantum algorithm for approximating partition functions. Phys. Rev. A, 80:022340, Aug 2009.
- Fa-Yueh Wu. The potts model. Reviews of modern physics, 54(1):235, 1982.
- Coherent ising machines—optical neural networks operating at the quantum limit. npj Quantum Information, 3(1):49, 2017.