Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
166 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Deep Neural Network Solutions for Oscillatory Fredholm Integral Equations (2401.07003v1)

Published 13 Jan 2024 in math.NA, cs.LG, and cs.NA

Abstract: We studied the use of deep neural networks (DNNs) in the numerical solution of the oscillatory Fredholm integral equation of the second kind. It is known that the solution of the equation exhibits certain oscillatory behaviors due to the oscillation of the kernel. It was pointed out recently that standard DNNs favour low frequency functions, and as a result, they often produce poor approximation for functions containing high frequency components. We addressed this issue in this study. We first developed a numerical method for solving the equation with DNNs as an approximate solution by designing a numerical quadrature that tailors to computing oscillatory integrals involving DNNs. We proved that the error of the DNN approximate solution of the equation is bounded by the training loss and the quadrature error. We then proposed a multi-grade deep learning (MGDL) model to overcome the spectral bias issue of neural networks. Numerical experiments demonstrate that the MGDL model is effective in extracting multiscale information of the oscillatory solution and overcoming the spectral bias issue from which a standard DNN model suffers.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (29)
  1. The spectral problem for a class of highly oscillatory Fredholm integral operators. IMA Journal of Numerical Analysis, 30(1):108–130, 2010.
  2. Inverse acoustic and electromagnetic scattering theory, volume 93. Springer, New York, 1998.
  3. Kendall E. Atkinson. The Numerical Solution of Integral Equations of the Second Kind. Cambridge University Press, Cambridge, 1997.
  4. Multiscale methods for Fredholm integral equations, volume 28. Cambridge University Press, Cambridge, 2015.
  5. Oscillation preserving Galerkin methods for Fredholm integral equations of the second kind with oscillatory kernels. arXiv preprint arXiv:1507.01156, 2015.
  6. Asymptotics on the fredholm integral equation with a highly oscillatory and weakly singular kernel. Applied Mathematics and Computation, 456:128112, 2023.
  7. Maziar Raissi. Deep hidden physics models: Deep learning of nonlinear partial differential equations. The Journal of Machine Learning Research, 19(1):932–955, 2018.
  8. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics, 378:686–707, 2019.
  9. Bing Yu et al. The deep Ritz method: A deep learning-based numerical algorithm for solving variational problems. Communications in Mathematics and Statistics, 6(1):1–12, 2018.
  10. The oscillation of solutions of volterra integral and integro-differential equations with highly oscillatory kernels. Journal of Integral Equations and Applications, 27(4):455–487, 2015.
  11. On the spectral bias of neural networks. Proceedings of the 36 th International Conference on Machine Learning, Long Beach, California, PMLR 97, 2019.
  12. Efficient quadrature of highly oscillatory integrals using derivatives. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 461(2057):1383–1399, 2005.
  13. EA Flinn. A modification of Filon’s method of numerical integration. Journal of the ACM, 7(2):181–184, 1960.
  14. Stability and convergence of collocation schemes for retarded potential integral equations. SIAM Journal on Numerical Analysis, 42(3):1167–1188, 2004.
  15. Asymptotic expansion and Filon-type methods for a Volterra integral equation with a highly oscillatory kernel. IMA Journal of Numerical Analysis, 31(2):469–490, 2011.
  16. Computing integrals involved the gaussian function with a small standard deviation. Journal of Scientific Computing, 78:1744–1767, 2018.
  17. Computing highly oscillatory integrals. Mathematics of Computation, 87(309):309–345, 2018.
  18. David Levin. Analysis of a collocation method for integrating rapidly oscillatory functions. Journal of Computational and Applied Mathematics, 78(1):131–138, 1997.
  19. Sheehan Olver. Gmres for the differentiation operator. SIAM Journal on Numerical Analysis, 47(5):3359–3373, 2009.
  20. Sheehan Olver. Fast, numerically stable computation of oscillatory integrals with stationary points. BIT Numerical Mathematics, 50:149–171, 2010.
  21. John P Boyd. Asymptotic coefficients of Hermite function series. Journal of Computational Physics, 54(3):382–410, 1984.
  22. Yuesheng Xu. Multi-grade deep learning. arXiv preprint arXiv:2302.00150, 02 2023.
  23. Y. Xu and T. Zeng. Multi-grade deep learning for partial differential equations with applications to the burgers equation. arXiv preprint arXiv:2309.07401, 2023.
  24. Convergence of deep convolutional neural networks. Neural Networks, 153:553–563, 07 2022.
  25. Y. Xu and H. Zhang. Convergence of deep relu networks. Neurocomputing, page 127174, 2023.
  26. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In Proceedings of the IEEE International Conference on Computer Vision, pages 1026–1034, 2015.
  27. Methods of numerical integration. Courier Corporation, New York, 2007.
  28. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  29. Y. Xu and T. Zeng. Sparse deep neural network for nonlinear partial differential equations. Numerical Mathematics: Theory, Methods and Applications, 16(1), 2022.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now