Papers
Topics
Authors
Recent
Search
2000 character limit reached

MD-NOMAD: Mixture density nonlinear manifold decoder for emulating stochastic differential equations and uncertainty propagation

Published 24 Apr 2024 in cs.LG | (2404.15731v2)

Abstract: We propose a neural operator framework, termed mixture density nonlinear manifold decoder (MD-NOMAD), for stochastic simulators. Our approach leverages an amalgamation of the pointwise operator learning neural architecture nonlinear manifold decoder (NOMAD) with mixture density-based methods to estimate conditional probability distributions for stochastic output functions. MD-NOMAD harnesses the ability of probabilistic mixture models to estimate complex probability and the high-dimensional scalability of pointwise neural operator NOMAD. We conduct empirical assessments on a wide array of stochastic ordinary and partial differential equations and present the corresponding results, which highlight the performance of the proposed framework.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. Christopher M Bishop. Mixture density networks. 1994.
  2. Adaptive sparse polynomial chaos expansion based on least angle regression. Journal of computational Physics, 230(6):2345–2367, 2011.
  3. Generative modeling of time-dependent densities via optimal transport and projection pursuit. Chaos: An Interdisciplinary Journal of Nonlinear Science, 33(10), 2023.
  4. Stochastic simulators based optimization by gaussian process metamodels–application to maintenance investments planning issues. Quality and Reliability Engineering International, 32(6):2067–2080, 2016.
  5. Souvik Chakraborty et al. Deep physics corrector: A physics enhanced deep learning architecture for solving stochastic differential equations. Journal of Computational Physics, 479:112004, 2023.
  6. Learning effective stochastic differential equations from microscopic simulations: Linking stochastic numerics to deep learning. Chaos: An Interdisciplinary Journal of Nonlinear Science, 33(2), 2023.
  7. Sam Efromovich. Dimension reduction and adaptation in conditional density estimation. Journal of the American Statistical Association, 105(490):761–774, 2010.
  8. Local polynomial modelling and its applications: monographs on statistics and applied probability 66. Routledge, 2018.
  9. Variational bayes deep operator network: a data-driven bayesian solver for parametric differential equations. arXiv preprint arXiv:2206.05655, 2022.
  10. Cross-validation and the estimation of conditional probability densities. Journal of the American Statistical Association, 99(468):1015–1026, 2004.
  11. Generalized additive models. Routledge, 2017.
  12. Analysis of numerical methods. Courier Corporation, 1994.
  13. Neural sdes as infinite-dimensional gans. In International conference on machine learning, pages 5453–5463. PMLR, 2021.
  14. Stochastic differential equations. In Numerical Solution of Stochastic Differential Equations, pages 103–160. Springer, 1992.
  15. Neural operator: Learning maps between function spaces with applications to pdes. Journal of Machine Learning Research, 24(89):1–97, 2023.
  16. Error estimates for deeponets: A deep learning framework in infinite dimensions. Transactions of Mathematics and Its Applications, 6(1):tnac001, 2022.
  17. Randall J LeVeque. Finite volume methods for hyperbolic problems, volume 31. Cambridge university press, 2002.
  18. Randall J LeVeque. Finite difference methods for ordinary and partial differential equations: steady-state and time-dependent problems. SIAM, 2007.
  19. Fourier neural operator for parametric partial differential equations. arXiv preprint arXiv:2010.08895, 2020.
  20. Learning nonlinear operators via deeponet based on the universal approximation theorem of operators. Nature machine intelligence, 3(3):218–229, 2021.
  21. Learning the temporal evolution of multivariate densities via normalizing flows. Chaos: An Interdisciplinary Journal of Nonlinear Science, 32(3), 2022.
  22. Generalized linear models. Routledge, 2019.
  23. Parviz Moin. Fundamentals of engineering numerical analysis. Cambridge University Press, 2010.
  24. Allan Pinkus. N-widths in Approximation Theory, volume 7. Springer Science & Business Media, 2012.
  25. Junuthula Narasimha Reddy. An introduction to the finite element method. New York, 27:14, 1993.
  26. Conditional generative moment-matching networks. Advances in Neural Information Processing Systems, 29:2928–2936, 2016.
  27. Andreas Rößler. Runge–kutta methods for the strong approximation of solutions of stochastic differential equations. SIAM Journal on Numerical Analysis, 48(3):922–952, 2010.
  28. Stochastic differential equation model for cerebellar granule cell excitability. PLoS computational biology, 4(2):e1000004, 2008.
  29. Nomad: Nonlinear manifold decoders for operator learning. Advances in Neural Information Processing Systems, 35:5601–5613, 2022.
  30. Deep uq: Learning deep neural network surrogate models for high dimensional uncertainty quantification. Journal of computational physics, 375:565–588, 2018.
  31. Wavelet neural operator: a neural operator for parametric partial differential equations. arXiv preprint arXiv:2205.02191, 2022.
  32. A.B. Tsybakov. Introduction to Nonparametric Estimation. Springer Series in Statistics. Springer, New York, NY, 2009.
  33. Physics-informed generative adversarial networks for stochastic differential equations. SIAM Journal on Scientific Computing, 42(1):A292–A317, 2020.
  34. X. Zhu and B. Sudret. Emulation of stochastic simulators using generalized lambda models, 2021.
  35. Replication-based emulation of the response distribution of stochastic simulators using generalized lambda distributions. International Journal for Uncertainty Quantification, 10(3), 2020.
  36. Stochastic polynomial chaos expansions to emulate stochastic simulators. International Journal for Uncertainty Quantification, 13(2), 2023.
Citations (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.