Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
158 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Accelerating Fractional PINNs using Operational Matrices of Derivative (2401.14081v1)

Published 25 Jan 2024 in cs.LG, cs.NA, and math.NA

Abstract: This paper presents a novel operational matrix method to accelerate the training of fractional Physics-Informed Neural Networks (fPINNs). Our approach involves a non-uniform discretization of the fractional Caputo operator, facilitating swift computation of fractional derivatives within Caputo-type fractional differential problems with $0<\alpha<1$. In this methodology, the operational matrix is precomputed, and during the training phase, automatic differentiation is replaced with a matrix-vector product. While our methodology is compatible with any network, we particularly highlight its successful implementation in PINNs, emphasizing the enhanced accuracy achieved when utilizing the Legendre Neural Block (LNB) architecture. LNB incorporates Legendre polynomials into the PINN structure, providing a significant boost in accuracy. The effectiveness of our proposed method is validated across diverse differential equations, including Delay Differential Equations (DDEs) and Systems of Differential Algebraic Equations (DAEs). To demonstrate its versatility, we extend the application of the method to systems of differential equations, specifically addressing nonlinear Pantograph fractional-order DDEs/DAEs. The results are supported by a comprehensive analysis of numerical outcomes.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. Bruce J West “Fractional calculus view of complexity: tomorrow’s science” CRC Press, 2016
  2. “Linking the fractional derivative and the Lomnitz creep law to non-Newtonian time-varying viscosity” In Physical Review E 94.3 APS, 2016, pp. 032606
  3. “Optimal random search, fractional dynamics and fractional calculus” In Fractional Calculus and Applied Analysis 17.2 Versita, 2014, pp. 321–332
  4. “Fractional-order systems and controls: fundamentals and applications” Springer Science & Business Media, 2010
  5. Jun Zhang, Zhihui Wei and Liang Xiao “Adaptive fractional-order multi-scale method for image denoising” In Journal of Mathematical Imaging and Vision 43 Springer, 2012, pp. 39–49
  6. Guo–Cheng Wu, Dumitru Baleanu and Sheng–Da Zeng “Finite-time stability of discrete fractional delay systems: Gronwall inequality and stability criterion” In Communications in Nonlinear Science and Numerical Simulation 57 Elsevier, 2018, pp. 299–308
  7. Hal L Smith “An introduction to delay differential equations with applications to the life sciences” springer New York, 2011
  8. Rodney David Driver “Ordinary and delay differential equations” Springer Science & Business Media, 2012
  9. Fathalla A Rihan “Delay differential equations and applications to biology” Springer, 2021
  10. B Van Brunt and GC Wake “A Mellin transform solution to a second-order pantograph equation with linear dispersion arising in a cell growth model” In European Journal of Applied Mathematics 22.2 Cambridge University Press, 2011, pp. 151–168
  11. Walter G Aiello, HI Freedman and Jianhong Wu “Analysis of a model representing stage-structured population growth with state-dependent time delay” In SIAM Journal on Applied Mathematics 52.3 SIAM, 1992, pp. 855–869
  12. John Richard Ockendon and Alan B Tayler “The dynamics of a current collection system for an electric locomotive” In Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences 322.1551 The Royal Society London, 1971, pp. 447–468
  13. “Fractional Variable-Order Derivative and Difference Operators and Their Applications to Dynamical Systems Modelling” In Fractional Dynamical Systems: Methods, Algorithms and Applications Springer, 2022, pp. 107–133
  14. Ismail T Huseynov and Nazim I Mahmudov “A class of Langevin time-delay differential equations with general fractional orders and their applications to vibration theory” In Journal of King Saud University-Science 33.8 Elsevier, 2021, pp. 101596
  15. “The memory effect on fractional calculus: an application in the spread of COVID-19” In Computational and Applied Mathematics 40 Springer, 2021, pp. 1–21
  16. Robert J Bauer, Gary Mo and Wojciech Krzyzanski “Solving delay differential equations in S-ADAPT by method of steps” In Computer methods and programs in biomedicine 111.3 Elsevier, 2013, pp. 715–734
  17. Zhanwen Yang, Qi Li and Zichen Yao “A stability analysis for multi-term fractional delay differential equations with higher order” In Chaos, Solitons & Fractals 167 Elsevier, 2023, pp. 112997
  18. M Mustafa Bahşi and Mehmet Çevik “Numerical solution of pantograph-type delay differential equations using perturbation-iteration algorithms” In Journal of Applied Mathematics 2015 Hindawi, 2015
  19. Andi Johnson “Investigation of Network Models Finite difference Method” In Eurasian Journal of Chemical, Medicinal and Petroleum Research 2.1 Amir Samimi Company (ASC), 2023, pp. 1–9
  20. “Numerical solution of delay differential equation using two-derivative Runge-Kutta type method with Newton interpolation” In Alexandria Engineering Journal 61.8 Elsevier, 2022, pp. 5819–5835
  21. Pham Huu Anh Ngoc and Ky Quan Tran “On stability of solutions of stochastic delay differential equations” In Systems & Control Letters 169 Elsevier, 2022, pp. 105384
  22. “A new multi-step method for solving delay differential equations using Lagrange interpolation” In Journal of the Nigerian Society of Physical Sciences, 2021, pp. 159–164
  23. Nikhil Sriwastav and Amit K Barnwal “Numerical solution of Lane-Emden pantograph delay differential equation: stability and convergence analysis” In International Journal of Mathematical Modelling and Numerical Optimisation 13.1 Inderscience Publishers (IEL), 2023, pp. 64–83
  24. Mo Faheem, Akmal Raza and Arshad Khan “Wavelet collocation methods for solving neutral delay differential equations” In International Journal of Nonlinear Sciences and Numerical Simulation 23.7-8 De Gruyter, 2022, pp. 1129–1156
  25. “Solving a new design of nonlinear second-order Lane–Emden pantograph delay differential model via Bernoulli collocation method” In The European Physical Journal Plus 135.5 Springer, 2020, pp. 1–12
  26. H Jafari, M Mahmoudi and MH Noori Skandari “A new numerical method to solve pantograph delay differential equations with convergence analysis” In Advances in Difference Equations 2021.1 SpringerOpen, 2021, pp. 1–12
  27. Waleed M Abd-Elhameed, José A Tenreiro Machado and Youssri H Youssri “Hypergeometric fractional derivatives formula of shifted Chebyshev polynomials: tau algorithm for a type of fractional delay differential equations” In International Journal of Nonlinear Sciences and Numerical Simulation 23.7-8 De Gruyter, 2022, pp. 1253–1268
  28. Muyang Liu, Ioannis Dassios and Federico Milano “On the stability analysis of systems of neutral delay differential equations” In Circuits, Systems, and Signal Processing 38 Springer, 2019, pp. 1639–1653
  29. “A Galerkin meshless reproducing kernel particle method for numerical solution of neutral delay time-space distributed-order fractional damped diffusion-wave equation” In Applied Numerical Mathematics 169 Elsevier, 2021, pp. 44–63
  30. “A local meshless method based on the finite collocation and local integral equations method for delay PDEs” In Engineering Analysis with Boundary Elements 83 Elsevier, 2017, pp. 67–73
  31. Ercan Celik, Mustafa Bayram and Turgut Yeloglu “Solution of differential-algebraic equations (DAEs) by adomian decomposition method” In International Journal Pure & Applied Mathematical Sciences 3.1, 2006, pp. 93–100
  32. “On the numerical solution of differential-algebraic equations by Padé series” In Applied mathematics and computation 137.1 Elsevier, 2003, pp. 151–160
  33. Fahimeh Soltanian, Mehdi Dehghan and Seyed-Mehdi Karbassi “Solution of the differential algebraic equations via homotopy perturbation method and their engineering applications” In International Journal of Computer Mathematics 87.9 Taylor & Francis, 2010, pp. 1950–1974
  34. Mohammad Zurigat, Shaher Momani and Ahmad Alawneh “Analytical approximate solutions of systems of fractional algebraic–differential equations by homotopy analysis method” In Computers & Mathematics with Applications 59.3 Elsevier, 2010, pp. 1227–1235
  35. Tayebeh Taheri, Alireza Afzal Aghaei and Kourosh Parand “Bridging machine learning and weighted residual methods for delay differential equations of fractional order” In Applied Soft Computing Elsevier, 2023, pp. 110936
  36. “Orthonormal Bernoulli wavelets neural network method and its application in astrophysics” In Computational and Applied Mathematics 40 Springer, 2021, pp. 1–24
  37. “Intelligent computing technique for solving singular multi-pantograph delay differential equation” In Soft Computing 26.14 Springer, 2022, pp. 6701–6713
  38. “Design of backpropagated intelligent networks for nonlinear second-order Lane–Emden pantograph delay differential systems” In Arabian Journal for Science and Engineering 47.2 Springer, 2022, pp. 1197–1210
  39. “Neural network method: delay and system of delay differential equations” In Engineering with Computers 38.Suppl 3 Springer, 2022, pp. 2423–2432
  40. “SLeNN-ELM: A shifted Legendre neural network method for fractional delay differential equations based on extreme learning machine” In NHM 18.1, 2023, pp. 494–512
  41. “SYNC: Safety-aware neural control for stabilizing stochastic delay-differential equations” In The Eleventh International Conference on Learning Representations, 2023
  42. “Deep neural networks motivated by partial differential equations” In Journal of Mathematical Imaging and Vision 62 Springer, 2020, pp. 352–364
  43. “Fractional Chebyshev deep neural network (FCDNN) for solving differential models” In Chaos, Solitons & Fractals 153 Elsevier, 2021, pp. 111530
  44. “A neural network approach for solving nonlinear differential equations of Lane–Emden type” In Engineering with Computers Springer, 2023, pp. 1–17
  45. Maziar Raissi, Paris Perdikaris and George E Karniadakis “Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations” In Journal of Computational physics 378 Elsevier, 2019, pp. 686–707
  46. “RPINNs: Rectified-physics informed neural networks for solving stationary partial differential equations” In Computers & Fluids 245 Elsevier, 2022, pp. 105583
  47. “A-PINN: Auxiliary physics informed neural networks for forward and inverse problems of nonlinear integro-differential equations” In Journal of Computational Physics 462 Elsevier, 2022, pp. 111260
  48. “Physics-informed neural networks for heat transfer problems” In Journal of Heat Transfer 143.6 American Society of Mechanical Engineers, 2021, pp. 060801
  49. “Physics informed neural networks (PINNs) for approximating nonlinear dispersive PDEs” In arXiv preprint arXiv:2104.05584, 2021
  50. Guofei Pang, Lu Lu and George Em Karniadakis “fPINNs: Fractional physics-informed neural networks” In SIAM Journal on Scientific Computing 41.4 SIAM, 2019, pp. A2603–A2626
  51. “Identifiability and predictability of integer-and fractional-order epidemiological models using physics-informed neural networks” In Nature Computational Science 1.11 Nature Publishing Group US New York, 2021, pp. 744–753
  52. Guozheng Wu, Fajie Wang and Lin Qiu “Physics-informed neural network for solving Hausdorff derivative Poisson equations” In Fractals World Scientific, 2023, pp. 2340103
  53. “Solving differential equations with unknown constitutive relations as recurrent neural networks” In arXiv preprint arXiv:1710.02242, 2017
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets