Learning Neural Operators on Riemannian Manifolds (2302.08166v2)
Abstract: In AI and computational science, learning the mappings between functions (called operators) defined on complex computational domains is a common theoretical challenge. Recently, Neural Operator emerged as a promising framework with a discretisation-independent model structure to break the fixed-dimension limitation of classical deep learning models. However, existing operator learning methods mainly focus on regular computational domains, and many components of these methods rely on Euclidean structural data. In real-life applications, many operator learning problems are related to complex computational domains such as complex surfaces and solids, which are non-Euclidean and widely referred to as Riemannian manifolds. Here, we report a new concept, Neural Operator on Riemannian Manifolds (NORM), which generalises Neural Operator from being limited to Euclidean spaces to being applicable to Riemannian manifolds, and can learn the mapping between functions defined on any real-life complex geometries, while preserving the discretisation-independent model structure. NORM shifts the function-to-function mapping to finite-dimensional mapping in the Laplacian eigenfunctions' subspace of geometry, and holds universal approximation property in learning operators on Riemannian manifolds even with only one fundamental block. The theoretical and experimental analysis prove that NORM is a significant step forward in operator learning and has the potential to solve complex problems in many fields of applications sharing the same nature and theoretical principle.
- Scientific discovery in the age of artificial intelligence. Nature, 620(7972):47–60, 2023.
- Magnetic control of tokamak plasmas through deep reinforcement learning. Nature, 602(7897):414–419, 2022.
- Neural operator: Graph kernel network for partial differential equations. arXiv preprint arXiv:2003.03485, 2020.
- Fourier neural operator with learned deformations for pdes on general geometries. arXiv preprint arXiv:2207.05209, 2022.
- Learning the solution operator of parametric partial differential equations with physics-informed deeponets. Science advances, 7(40):eabi8605, 2021.
- Neural ordinary differential equations. Advances in neural information processing systems, 31, 2018.
- Machine learning for partial differential equations, 2023.
- Fourier neural operator for plasma modelling. arXiv preprint arXiv:2302.06542, 2023.
- Impact of atrial fibrillation on left atrium haemodynamics: A computational fluid dynamics study. Computers in Biology and Medicine, 150:106143, 2022.
- Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4d flow mri data using physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering, 358:112623, 2020.
- Fast predictions of aircraft aerodynamics using deep-learning techniques. AIAA Journal, 60(9):5249–5261, 2022.
- Accelerating part-scale simulation in liquid metal jet additive manufacturing via operator learning. arXiv preprint arXiv:2202.03665, 2022.
- Physics-informed machine learning. Nature Reviews Physics, 3(6):422–440, 2021.
- Neural operators for accelerating scientific simulations and design. arXiv preprint arXiv:2309.15325, 2023.
- Making costly manufacturing smart with transfer learning under limited data: A case study on composites autoclave processing. Journal of Manufacturing Systems, 59:345–354, 2021.
- U-net architectures for fast prediction of incompressible laminar flows. arXiv preprint arXiv:1910.13532, 2019.
- Solving high-dimensional pdes with latent spectral models. arXiv preprint arXiv:2301.12664, 2023.
- Graph attention networks. stat, 1050(20):10–48550, 2017.
- Graph neural networks for laminar flow prediction around random two-dimensional shapes. Physics of Fluids, 33(12):123607, 2021.
- A comprehensive and fair comparison of two neural operators (with practical extensions) based on fair data. Computer Methods in Applied Mechanics and Engineering, 393:114778, 2022.
- Nonlocal kernel network (nkn): a stable and resolution-independent deep neural network. arXiv preprint arXiv:2201.02217, 2022.
- Learning nonlinear operators via deeponet based on the universal approximation theorem of operators. Nature machine intelligence, 3(3):218–229, 2021.
- Fourier neural operator for parametric partial differential equations. arXiv preprint arXiv:2010.08895, 2020.
- Neural operator: Learning maps between function spaces. arXiv preprint arXiv:2108.08481, 2021.
- U-no: U-shaped neural operators. arXiv preprint arXiv:2204.11127, 2022.
- Multiwavelet-based operator learning for differential equations. Advances in neural information processing systems, 34:24048–24062, 2021.
- Phygeonet: Physics-informed geometry-adaptive convolutional neural networks for solving parameterized steady-state pdes on irregular domain. Journal of Computational Physics, 428:110079, 2021.
- Resampling images to a regular grid from a non-regular subset of pixel positions using frequency selective reconstruction. IEEE Transactions on Image Processing, 24(11):4540–4555, 2015.
- On the optimality of shape and data representation in the spectral domain. SIAM Journal on Imaging Sciences, 8(2):1141–1160, 2015.
- Model reduction and neural networks for parametric pdes. The SMAI journal of computational mathematics, 7:121–157, 2021.
- Nomad: Nonlinear manifold decoders for operator learning. arXiv preprint arXiv:2206.03551, 2022.
- Spectral methods to solve nonlinear problems: A review. Partial Differential Equations in Applied Mathematics, 4:100043, 2021.
- Giuseppe Patanè. Laplacian spectral basis functions. Computer aided geometric design, 65:31–47, 2018.
- Spectral multidimensional scaling. Proceedings of the National Academy of Sciences, 110(45):18052–18057, 2013.
- Terence Tao. Fourier transform. https://www.math.ucla.edu/~tao/preprints/fourier.pdf, 2016.
- Laplace–beltrami spectra as ‘shape-dna’of surfaces and solids. Computer-Aided Design, 38(4):342–366, 2006.
- Properties of laplace operators for tetrahedral meshes. In Computer Graphics Forum, volume 39, pages 55–68. Wiley Online Library, 2020.
- Error estimates for deeponets: A deep learning framework in infinite dimensions. Transactions of Mathematics and Its Applications, 6(1):tnac001, 2022.
- Inductive representation learning on large graphs. Advances in neural information processing systems, 30, 2017.
- Hunter Rouse. Modern conceptions of the mechanics of fluid turbulence. Transactions of the American Society of Civil Engineers, 102(1):463–505, 1937.
- Transforming heat transfer with thermal metamaterials and devices. Nature Reviews Materials, 6(6):488–507, 2021.
- Self-resistance electric heating of shaped cfrp laminates: temperature distribution optimization and validation. The International Journal of Advanced Manufacturing Technology, 121(3-4):1755–1768, 2022.
- Numerical optimisation of thermoset composites manufacturing processes: A review. Composites Part A: Applied Science and Manufacturing, 124:105499, 2019.
- Timothy W Secomb. Hemodynamics. Comprehensive physiology, 6(2):975, 2016.
- Transient hemodynamics prediction using an efficient octree-based deep learning model. In International Conference on Information Processing in Medical Imaging, pages 183–194. Springer, 2023.
- Investigation of pulsatile flowfield in healthy thoracic aorta models. Annals of biomedical engineering, 38:391–402, 2010.
- Spectral methods for solving elliptic pdes on unknown manifolds. Journal of Computational Physics, 486:112132, 2023.
- A laplacian for nonmanifold triangle meshes. In Computer Graphics Forum, volume 39, pages 69–80. Wiley Online Library, 2020.