Analog Iterative Machine (AIM): using light to solve quadratic optimization problems with mixed variables (2304.12594v2)
Abstract: Solving optimization problems is challenging for existing digital computers and even for future quantum hardware. The practical importance of diverse problems, from healthcare to financial optimization, has driven the emergence of specialised hardware over the past decade. However, their support for problems with only binary variables severely restricts the scope of practical problems that can be efficiently embedded. We build analog iterative machine (AIM), the first instance of an opto-electronic solver that natively implements a wider class of quadratic unconstrained mixed optimization (QUMO) problems and supports all-to-all connectivity of both continuous and binary variables.Beyond synthetic 7-bit problems at small-scale, AIM solves the financial transaction settlement problem entirely in analog domain with higher accuracy than quantum hardware and at room temperature. With compute-in-memory operation and spatial-division multiplexed representation of variables, the design of AIM paves the path to chip-scale architecture with 100 times speed-up per unit-power over the latest GPUs for solving problems with 10,000 variables. The robustness of the AIM algorithm at such scale is further demonstrated by comparing it with commercial production solvers across multiple benchmarks, where for several problems we report new best solutions. By combining the superior QUMO abstraction, sophisticated gradient descent methods inspired by machine learning, and commodity hardware, AIM introduces a novel platform with a step change in expressiveness, performance, and scalability, for optimization in the post-Moores law era.
- “Focus Beyond Quadratic Speedups for Error-Corrected Quantum Advantage” In PRX Quantum 2, 2021, pp. 010103 URL: https://journals.aps.org/prxquantum/abstract/10.1103/PRXQuantum.2.010103
- “Network of time-multiplexed optical parametric oscillators as a coherent Ising machine” In Nature Photonics 8, 2014, pp. 937–942
- “A fully programmable 100-spin coherent Ising machine with all-to-all connections” In Science 354.6312 American Association for the Advancement of Science, 2016, pp. 614–617
- “A coherent Ising machine for 2000-node optimization problems” In Science 354.6312 American Association for the Advancement of Science, 2016, pp. 603–606
- “Power-efficient combinatorial optimization using intrinsic noise in memristor Hopfield neural networks” In Nature Electronics Nature Publishing Group, 2020, pp. 1–10
- “Realizing the classical XY Hamiltonian in polariton simulators” In Nature Materials 16.11 Nature Publishing Group UK London, 2017, pp. 1120–1126
- “Polaritonic xy-ising machine” In Nanophotonics 9.13 De Gruyter, 2020, pp. 4127–4138
- “Rapid fair sampling of the X Y spin Hamiltonian with a laser simulator” In Physical Review Research 2.3 APS, 2020, pp. 033008
- “A single shot coherent Ising machine based on a network of injection-locked multicore fiber lasers” In Nature Communications 10.1 Nature Publishing Group UK London, 2019, pp. 3516
- “Realizing spin Hamiltonians in nanoscale active photonic lattices” In Nature Materials 19.7 Nature Publishing Group UK London, 2020, pp. 725–731
- D Pierangeli, G Marcucci and C Conti “Large-scale photonic Ising machine by spatial light modulation” In Physical Review Letters 122.21 APS, 2019, pp. 213902
- “Heuristic recurrent algorithms for photonic Ising machines” In Nature Communications 11.1 Nature Publishing Group UK London, 2020, pp. 249
- “Analog computing using graphene-based metalines” In Optics Letters 40.22 Optica Publishing Group, 2015, pp. 5239–5242
- “Spatial optical integrator based on phase-shifted Bragg gratings” In Optics Communications 338 Elsevier, 2015, pp. 457–460
- “Dielectric metasurfaces solve differential and integro-differential equations” In Optics Letters 42.7 Optical Society of America, 2017, pp. 1197–1200
- “Demonstration of chip-based coupled degenerate optical parametric oscillators for realizing a nanophotonic spin-glass” In Nature communications 11.1 Nature Publishing Group, 2020, pp. 1–7
- John Joseph Hopfield “Neural networks and physical systems with emergent collective computational abilities.” In Proceedings of the National Academy of Sciences 79.8, 1982, pp. 2554–2558 DOI: 10.1073/pnas.79.8.2554
- John J Hopfield and David W Tank ““Neural” computation of decisions in optimization problems” In Biological Cybernetics 52.3 Springer, 1985, pp. 141–152
- Bryan Jacobs “Quantum-Inspired Classical Computing (QuICC)”, Call for Proposals, 2021 DARPA - Microsystems Technology Office URL: https://sam.gov/api/prod/opps/v3/opportunities/resources/files/3d127616769945eebff9ebcceca81ead/download?&token=
- “D-Wave machine”, 2023 URL: https://www.dwavesys.com/
- “Quantum algorithms for mixed binary optimization applied to transaction settlement” In IEEE Transactions on Quantum Engineering 2 IEEE, 2021, pp. 1–8
- J.E. Beasley “Portfolio Optimisation: Models and Solution Approaches” In Theory Driven by Influential Applications INFORMS, 2013, pp. 201–221 DOI: 10.1287/educ.2013.0114
- Thomas Böhlke, Utz-Uwe Haus and Volker Schulze “Crystallographic texture approximation by quadratic programming” In Acta Materialia 54.5, 2006, pp. 1359–1368 DOI: https://doi.org/10.1016/j.actamat.2005.11.009
- David L Donoho “Compressed sensing” In IEEE Transactions on Information Theory 52.4 IEEE, 2006, pp. 1289–1306
- “Quantum Algorithms for Mixed Binary Optimization Applied to Transaction Settlement” In IEEE Transactions on Quantum Engineering 2, 2021, pp. 1–8 DOI: 10.1109/TQE.2021.3063635
- “G-set instances” URL: https://web.stanford.edu/~yyye/yyye/Gset/
- “Wishart planted ensemble: A tunably rugged pairwise Ising model with a first-order phase transition” In Physical Review E 101.5 APS, 2020, pp. 052102
- “From near to eternity: spin-glass planting, tiling puzzles, and constraint-satisfaction problems” In Physical Review E 97.4 APS, 2018, pp. 043303
- Firas Hamze “Rotationally-Constrained Discrepancy Problems (RCDPs)” In Unpublished, 2022
- “QPLIB: a library of quadratic programmming instances” In Mathematical Programming Computation 11 Elsevier, 2019, pp. 237–265 DOI: 10.1007/s12532-018-0147-4
- “Microsoft Quantum Inspired Optimisation (QIO) provider”, 2022 URL: https://learn.microsoft.com/en-us/azure/quantum/provider-microsoft-qio
- “Gurobi optimizer reference manual”, 2023 URL: http://www.gurobi.com
- “Computational overhead of locality reduction in binary optimization problems” In Computer Physics Communications 269 Elsevier, 2021, pp. 108102
- Boris T. Polyak “Some methods of speeding up the convergence of iteration methods” In USSR Computational Mathematics and Mathematical Physics, 1962
- Ning Qian “On the momentum term in gradient descent learning algorithms” In Neural Networks 12.1 Elsevier, 1999, pp. 145–151
- “Coherent ising machines with optical error correction circuits” In Advanced Quantum Technologies 4.11 Wiley Online Library, 2021, pp. 2100077
- Joseph W Goodman, AR Dias and LM Woody “Fully parallel, high-speed incoherent optical method for performing discrete Fourier transforms” In Optics Letters 2.1 Optical Society of America, 1978, pp. 1–3
- “An optical neural network using less than 1 photon per multiplication” In Nature Communications 13.1 Nature Publishing Group UK London, 2022, pp. 123
- “Solvable model of a spin-glass” In Phys. Rev. Lett 35.26, 1975, pp. 1792–1796
- Sebastian Gedin “Securities settlement optimization using an optimization software solution”, 2020
- “QPLIB: A Library of Quadratic Programming Instances”, 2021 Zuse Institute Berlin URL: http://qplib.zib.de/
- “Chook–A comprehensive suite for generating binary optimization problems with planted solutions” In arXiv preprint arXiv:2005.14344, 2020
- “Interactive charts comparing the results of Hans Mittelmann’s benchmarks.”, 2023 URL: https://mattmilten.github.io/mittelmann-plots/
- “Physics-inspired optimization for quadratic unconstrained problems using a digital annealer” In Frontiers in Physics 7 Frontiers Media SA, 2019, pp. 48
- “Nonequilibrium Monte Carlo for unfreezing variables in hard combinatorial optimization” In arXiv preprint arXiv:2111.13628, 2021
- “On the Emerging Potential of Quantum Annealing Hardware for Combinatorial Optimization” In arXiv preprint arXiv:2210.04291, 2022
- John N Hooker and Maria A Osorio “Mixed logical-linear programming” In Discrete Applied Mathematics 96 Elsevier, 1999, pp. 395–442
- “Presolve reductions in mixed integer programming” In INFORMS Journal on Computing 32.2 INFORMS, 2020, pp. 473–506
- “An optical neural network using less than 1 photon per multiplication” In Nature Communications 13.1, 2022, pp. 1–8 DOI: 10.1038/s41467-021-27774-
- “Simulated tempering: a new Monte Carlo scheme” In Europhysics letters 19.6 IOP Publishing, 1992, pp. 451
- Firas Hamze “Rotationally-Constrained Discrepancy Problems (RCDPs)” Unpublished, 2023
- “A Spectral Bundle Method for Semidefinite Programming”, 1997 URL: https://opus4.kobv.de/opus4-zib/files/306/SC-97-37.pdf
- Michael R Garey, David S Johnson and Larry Stockmeyer “Some simplified NP-complete problems” In Proceedings of the sixth annual ACM Symposium on Theory of Computing, 1974, pp. 47–63
- Kirill P Kalinin and Natalia G Berloff “Computational complexity continuum within Ising formulation of NP problems” In Communications Physics 5.1 Nature Publishing Group UK London, 2022, pp. 20
- “Copositive programming for mixed-binary quadratic optimization via Ising solvers” In arXiv preprint arXiv:2207.13630, 2022
- “Quantum approximate optimization of non-planar graph problems on a planar superconducting processor” In Nature Physics 17.3 Nature Publishing Group, 2021, pp. 332–336
- “Compilation of fault-tolerant quantum heuristics for combinatorial optimization” In PRX Quantum 1.2 APS, 2020, pp. 020312
- David E Rumelhart, Geoffrey E Hinton and Ronald J Williams “Learning representations by back-propagating errors” In Nature 323.6088 Nature Publishing Group UK London, 1986, pp. 533–536
- “Solving integral equations in free space with inverse-designed ultrathin optical metagratings” In Nature Nanotechnology Nature Publishing Group, 2023, pp. 1–8
- “Time-delay to intensity mapping based on a second-order optical integrator: application to optical arbitrary waveform generation” In Optics Express 23.12 Optica Publishing Group, 2015, pp. 16209–16223
- “Deep learning-enabled compact optical trigonometric operator with metasurface” In PhotoniX 3.1 Springer, 2022, pp. 15
- “Performing mathematical operations using high-index acoustic metamaterials” In New Journal of Physics 20.7 IOP Publishing, 2018, pp. 073001
- Hayato Goto, Kosuke Tatsumura and Alexander R. Dixon “Combinatorial optimization by simulating adiabatic bifurcations in nonlinear Hamiltonian systems” In Science Advances 5.4 American Association for the Advancement of Science, 2019 DOI: 10.1126/sciadv.aav2372
- “High-performance combinatorial optimization based on classical mechanics” In Science Advances 7.6 American Association for the Advancement of Science, 2021, pp. eabe7953
- Manabu Torii and Martin T Hagan “Stability of steepest descent with momentum for quadratic functions” In IEEE Transactions on Neural Networks 13.3 IEEE, 2002, pp. 752–756
- [Acknowledgments] The authors wish to thank Lee Braine, Barclays chief technology office, for useful discussions about optimization problems and QUMO abstraction; Stephen Jordan, Brad Lackey, Amin Barzegar, Firas Hamze, Matthias Troyer and the MS Quantum team for useful discussions about optimization problems and for providing us with the QUBO benchmarks (Wishart, Tile3D, RCDP). We acknowledge helpful discussions, encouragement, and support from our colleagues at Cloud Systems Futures at Microsoft Research, Cambridge, UK, and at M365 Research, Microsoft, Redmond, USA. N.G.B. thanks the Julian Schwinger Foundation grant JSF-19-02-0005 for the financial support. [3] [Competing Interests] The authors of the paper have filed several patents relating to subject matter contained in this paper in the name of Microsoft Co. [4] [Correspondence] Correspondence and requests for materials should be addressed to [email protected]. Supplementary Information [Competing Interests] The authors of the paper have filed several patents relating to subject matter contained in this paper in the name of Microsoft Co. [4] [Correspondence] Correspondence and requests for materials should be addressed to [email protected]. Supplementary Information [Correspondence] Correspondence and requests for materials should be addressed to [email protected]. Supplementary Information
- [Competing Interests] The authors of the paper have filed several patents relating to subject matter contained in this paper in the name of Microsoft Co. [4] [Correspondence] Correspondence and requests for materials should be addressed to [email protected]. Supplementary Information [Correspondence] Correspondence and requests for materials should be addressed to [email protected]. Supplementary Information
- [Correspondence] Correspondence and requests for materials should be addressed to [email protected]. Supplementary Information