Large-scale photonic computing with nonlinear disordered media (2310.07690v1)
Abstract: Neural networks find widespread use in scientific and technological applications, yet their implementations in conventional computers have encountered bottlenecks due to ever-expanding computational needs. Photonic neuromorphic hardware, which manipulates information and represents data continuously in the optical domain, is one of the promising platforms with potential advantages of massive parallelism, ultralow latency, and reduced energy consumption. While linear photonic neural networks are within reach, photonic computing with large-scale optical nonlinear nodes remains largely unexplored. Here, we demonstrate a large-scale, high-performance nonlinear photonic neural system based on a disordered polycrystalline slab composed of lithium niobate nanocrystals. Mediated by random quasi-phase-matching and multiple scattering, linear and nonlinear optical speckle features are generated as the interplay between the simultaneous linear random scattering and the second-harmonic generation, defining a complex neural network in which the second-order nonlinearity acts as internal nonlinear activation functions. Benchmarked against linear random projection, such nonlinear mapping embedded with rich physical computational operations shows improved performance across a large collection of machine learning tasks in image classification, regression, and graph classification with varying complexity. Demonstrating up to 27,648 input and 3,500 nonlinear output nodes, the combination of optical nonlinearity and random scattering serves as a scalable computing engine for diverse applications.
- Gigan, S. Imaging and computing with disorder. Nature Physics 18, 980–985 (2022).
- Saade, A. et al. Random projections through multiple optical scattering: Approximating kernels at the speed of light. In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 6215–6219 (IEEE, 2016).
- Large-scale optical reservoir computing for spatiotemporal chaotic systems prediction. Physical Review X 10, 041037 (2020).
- Nonlinear optics. In Springer Handbook of Atomic, Molecular, and Optical Physics, 1097–1110 (Springer, 2008).
- Modeling of random quasi-phase-matching in birefringent disordered media. Physical Review Applied 15, 064070 (2021).
- Measuring the scattering tensor of a disordered nonlinear medium. Nature Physics 1–10 (2023).
- Zhou, T. et al. Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit. Nature Photonics 15, 367–373 (2021).
- Oguz, I. et al. Programming nonlinear propagation for efficient optical learning machines. arXiv preprint arXiv:2208.04951 (2022).
- Gradient-based learning applied to document recognition. Proceedings of the IEEE 86, 2278–2324 (1998).
- Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
- Swall0w. Torchstat. https://github.com/Swall0w/torchstat (2018).
- Kaplan, J. et al. Scaling laws for neural language models. arXiv preprint arXiv:2001.08361 (2020).
- Speckle decorrelation in fundamental and second-harmonic light scattered from nonlinear disorder. Physical Review Applied 18, 054047 (2022).