Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
102 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Physics-informed Neural Networks with Unknown Measurement Noise (2211.15498v5)

Published 28 Nov 2022 in stat.ML and cs.LG

Abstract: Physics-informed neural networks (PINNs) constitute a flexible approach to both finding solutions and identifying parameters of partial differential equations. Most works on the topic assume noiseless data, or data contaminated with weak Gaussian noise. We show that the standard PINN framework breaks down in case of non-Gaussian noise. We give a way of resolving this fundamental issue and we propose to jointly train an energy-based model (EBM) to learn the correct noise distribution. We illustrate the improved performance of our approach using multiple examples.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (35)
  1. Robust estimation in multiple linear regression model with non-Gaussian noise. Automatica, 44(2):407–417, 2008.
  2. Robust learning of physics informed neural networks. arXiv:2110.13330, 2021.
  3. Roger Barlow. Systematic errors: facts and fictions. arXiv preprint hep-ex/0207026, 2002.
  4. Three ways to solve partial differential equations with neural networks — a review. GAMM-Mitteilungen, 44(2):e202100006, 2021.
  5. Frank Bowman. Introduction to Bessel functions. Courier Corporation, 2012.
  6. Physics-informed neural networks (pinns) for fluid mechanics: a review. Acta Mechanica Sinica, 37(12):1727–1738, Dec 2021a.
  7. Physics-Informed Neural Networks for Heat Transfer Problems. Journal of Heat Transfer, 143(6), 04 2021b. 060801.
  8. Physics-informed learning of governing equations from scarce data. Nature Communications, 12(1):6136, Oct 2021.
  9. Catherine G. Constable. Parameter estimation in non-Gaussian noise. Geophysical Journal International, 94(1):131–142, 1988.
  10. Scientific machine learning through physics–informed neural networks: Where we are and what’s next. Journal of Scientific Computing, 92(3):88, Jul 2022.
  11. Probabilistic regression for visual tracking. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2020.
  12. Implicit generation and modeling with energy based models. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc., 2019.
  13. Bayesian Neural Networks: An Introduction and Survey, pages 45–87. Springer International Publishing, Cham, 2020.
  14. Energy-based models for deep probabilistic regression. In Andrea Vedaldi, Horst Bischof, Thomas Brox, and Jan-Michael Frahm, editors, Computer Vision – ECCV 2020, pages 325–343, Cham, 2020a. Springer International Publishing.
  15. How to train your energy-based model for regression. CoRR, abs/2005.01698, 2020b.
  16. On the existence of Gaussian noise (signal modelling). In Acoustics, Speech, and Signal Processing, IEEE International Conference on, pages 1673–1676. IEEE Computer Society, 1991.
  17. Physics-informed machine learning. Nature Reviews Physics, 3(6):422–440, 2021.
  18. Characterizing possible failure modes in physics-informed neural networks. In Advances in Neural Information Processing Systems, 2021.
  19. Artificial neural networks for solving ordinary and partial differential equations. IEEE transactions on neural networks, 9(5):987–1000, 1998.
  20. A tutorial on energy-based learning. Predicting structured data, 2006.
  21. Physics-informed neural networks for high-speed flows. Computer Methods in Applied Mechanics and Engineering, 360:112789, 2020.
  22. Stefano Markidis. The old and the new: Can physics-informed deep-learning replace traditional linear solvers? Frontiers in Big Data, 4, 2021.
  23. Self-adaptive physics-informed neural networks using a soft attention mechanism. arXiv:2009.04544, 2020.
  24. Jennifer Niedziela. Bessel functions and their applications. University of Tennessee-Knoxville, 2008.
  25. On the anatomy of MCMC-based maximum likelihood learning of energy-based models. Proceedings of the AAAI Conference on Artificial Intelligence, 34:5272–5280, Apr. 2020.
  26. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics, 378:686–707, 2019.
  27. Gaussian processes for machine learning. MIT press, 2006.
  28. Physics-informed neural networks for cardiac activation mapping. Frontiers in Physics, 8, 2020.
  29. Respecting causality is all you need for training physics-informed neural networks. arXiv:2203.07404, 2022.
  30. Larry Wasserman. All of statistics: a concise course in statistical inference, volume 26. Springer, 2004.
  31. Nonlinear system identification in impulsive environments. IEEE Transactions on signal processing, 53(7):2588–2594, 2005.
  32. Self-adaptive loss balanced physics-informed neural networks. Neurocomputing, 496:11–34, 2022.
  33. B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data. Journal of Computational Physics, 425:109913, 2021.
  34. Systems biology informed deep learning for inferring parameters and hidden dynamics. PLOS Computational Biology, 16(11):1–19, 11 2020.
  35. Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems. Computer Methods in Applied Mechanics and Engineering, 393:114823, 2022.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (2)
  1. Philipp Pilar (6 papers)
  2. Niklas Wahlström (17 papers)
Citations (5)
View on Semantic Scholar
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets