Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Learning Neural Constitutive Laws From Motion Observations for Generalizable PDE Dynamics (2304.14369v2)

Published 27 Apr 2023 in cs.LG and cs.GR

Abstract: We propose a hybrid neural network (NN) and PDE approach for learning generalizable PDE dynamics from motion observations. Many NN approaches learn an end-to-end model that implicitly models both the governing PDE and constitutive models (or material models). Without explicit PDE knowledge, these approaches cannot guarantee physical correctness and have limited generalizability. We argue that the governing PDEs are often well-known and should be explicitly enforced rather than learned. Instead, constitutive models are particularly suitable for learning due to their data-fitting nature. To this end, we introduce a new framework termed "Neural Constitutive Laws" (NCLaw), which utilizes a network architecture that strictly guarantees standard constitutive priors, including rotation equivariance and undeformed state equilibrium. We embed this network inside a differentiable simulation and train the model by minimizing a loss function based on the difference between the simulation and the motion observation. We validate NCLaw on various large-deformation dynamical systems, ranging from solids to fluids. After training on a single motion trajectory, our method generalizes to new geometries, initial/boundary conditions, temporal ranges, and even multi-physics systems. On these extremely out-of-distribution generalization tasks, NCLaw is orders-of-magnitude more accurate than previous NN approaches. Real-world experiments demonstrate our method's ability to learn constitutive laws from videos.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (98)
  1. Placental flattening via volumetric parameterization. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pp.  39–47. Springer, 2019.
  2. A comprehensive review on wheat flour dough rheology. Pakistan Journal of Food Sciences, 23(2):105–123, 2013.
  3. A three-dimensional constitutive model for the large stretch behavior of rubber elastic materials. Journal of the Mechanics and Physics of Solids, 41(2):389–412, 1993.
  4. A mechanics-informed artificial neural network approach in data-driven constitutive modeling. International Journal for Numerical Methods in Engineering, 123(12):2738–2759, 2022.
  5. Computer methods for ordinary differential equations and differential-algebraic equations, volume 61. Siam, 1998.
  6. Learning data-driven discretizations for partial differential equations. Proceedings of the National Academy of Sciences, 116(31):15344–15349, 2019.
  7. Real-time subspace integration for st. venant-kirchhoff deformable models. ACM transactions on graphics (TOG), 24(3):982–990, 2005.
  8. The measurement of soil properties in the triaxial test. 1962.
  9. Borja, R. I. Plasticity, volume 2. Springer, 2013.
  10. Virtual elastic objects. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.  15827–15837, 2022.
  11. Hybrid discrete-continuum modeling of shear localization in granular media. Journal of the Mechanics and Physics of Solids, 153:104404, 2021.
  12. Chhabra, R. P. Bubbles, drops, and particles in non-Newtonian fluids. CRC press, 2006.
  13. Crane, K. Keenan’s 3D Model Repository, 2020. URL https://www.cs.cmu.edu/~kmcrane/Projects/ModelRepository/.
  14. End-to-end differentiable physics for learning and control. Advances in neural information processing systems, 31, 2018.
  15. Computational methods for plasticity: theory and applications. John Wiley & Sons, 2011.
  16. A differentiable physics engine for deep learning in robotics. Frontiers in neurorobotics, pp.  6, 2019.
  17. Vector neurons: A general framework for so (3)-equivariant networks. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.  12200–12209, 2021.
  18. Soil mechanics and plastic analysis or limit design. Quarterly of applied mathematics, 10(2):157–165, 1952.
  19. Functional optimization of fluidic devices with differentiable stokes flow. ACM Transactions on Graphics (TOG), 39(6):1–15, 2020.
  20. Underwater soft robot modeling and control with differentiable simulation. IEEE Robotics and Automation Letters, 6(3):4994–5001, 2021a.
  21. Diffpd: Differentiable projective dynamics. ACM Transactions on Graphics (TOG), 41(2):1–21, 2021b.
  22. Stress-strain modeling of sands using artificial neural networks. Journal of geotechnical engineering, 121(5):429–435, 1995.
  23. Finite volume methods. Handbook of numerical analysis, 7:713–1018, 2000.
  24. Dnn2: A hyper-parameter reinforcement learning game for self-design of neural network based elasto-plastic constitutive descriptions. Computers & Structures, 249:106505, 2021.
  25. Fung, Y. Elasticity of soft tissues in simple elongation. American Journal of Physiology-Legacy Content, 213(6):1532–1544, 1967.
  26. Implicit constitutive modelling for viscoplasticity using neural networks. International Journal for Numerical Methods in Engineering, 43(2):195–219, 1998.
  27. Gpu optimization of material point methods. ACM Transactions on Graphics (TOG), 37(6):1–12, 2018.
  28. Add: Analytically differentiable dynamics for multi-body systems with frictional contact. ACM Transactions on Graphics (TOG), 39(6):1–15, 2020.
  29. Knowledge-based modeling of material behavior with neural networks. Journal of engineering mechanics, 117(1):132–153, 1991.
  30. A first course in continuum mechanics, volume 42. Cambridge University Press, 2008.
  31. The mechanics and thermodynamics of continua. Cambridge University Press, 2010.
  32. Haberman, R. Mathematical models: mechanical vibrations, population dynamics, and traffic flow. SIAM, 1998.
  33. Real2sim: Visco-elastic parameter estimation from dynamic motion. ACM Transactions on Graphics (TOG), 38(6):1–13, 2019.
  34. Hencky, H. The elastic behavior of vulcanized rubber. Rubber Chemistry and Technology, 6(2):217–224, 1933.
  35. Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415, 2016.
  36. A moving least squares material point method with displacement discontinuity and two-way rigid body coupling. ACM Transactions on Graphics (TOG), 37(4):1–14, 2018.
  37. Difftaichi: Differentiable programming for physical simulation. arXiv preprint arXiv:1910.00935, 2019a.
  38. Chainqueen: A real-time differentiable physical simulator for soft robotics. In 2019 International conference on robotics and automation (ICRA), pp.  6265–6271. IEEE, 2019b.
  39. Learning constitutive relations from indirect observations using deep neural networks. Journal of Computational Physics, 416:109491, 2020.
  40. Plasticinelab: A soft-body manipulation benchmark with differentiable physics. ICLR, 2021.
  41. Hughes, T. J. The finite element method: linear static and dynamic finite element analysis. Courier Corporation, 2012.
  42. The affine particle-in-cell method. ACM Transactions on Graphics (TOG), 34(4):1–10, 2015.
  43. The material point method for simulating continuum materials. In ACM SIGGRAPH 2016 Courses, pp.  1–52. 2016.
  44. Physics-informed machine learning. Nature Reviews Physics, 3(6):422–440, 2021.
  45. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  46. Drucker-prager elastoplasticity for sand animation. ACM Transactions on Graphics (TOG), 35(4):1–12, 2016.
  47. Polyconvex anisotropic hyperelasticity with neural networks. Journal of the Mechanics and Physics of Solids, 159:104703, 2022.
  48. Electrodynamics of continuous media, volume 8. elsevier, 2013.
  49. Computational homogenization of nonlinear elastic materials using neural networks. International Journal for Numerical Methods in Engineering, 104(12):1061–1084, 2015.
  50. Plasticitynet: Learning to simulate metal, sand, and snow for optimization time integration. Advances in Neural Information Processing Systems, 35:27783–27796, 2022.
  51. Graph neural network-accelerated lagrangian fluid simulation. Computers & Graphics, 103:201–211, 2022.
  52. Fourier neural operator for parametric partial differential equations. arXiv preprint arXiv:2010.08895, 2020.
  53. Differentiable cloth simulation for inverse problems. Advances in Neural Information Processing Systems, 32, 2019.
  54. Reynolds averaged turbulence modelling using deep neural networks with embedded invariance. Journal of Fluid Mechanics, 807:155–166, 2016.
  55. A learning-based multiscale method and its application to inelastic impact problems. Journal of the Mechanics and Physics of Solids, 158:104668, 2022.
  56. A generic physics-informed neural network-based constitutive model for soft biological tissues. Computer methods in applied mechanics and engineering, 372:113402, 2020.
  57. Deeponet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators. arXiv preprint arXiv:1910.03193, 2019.
  58. Diffaqua: A differentiable computational design pipeline for soft underwater swimmers with shape interpolation. ACM Transactions on Graphics (TOG), 40(4):1–14, 2021.
  59. Risp: Rendering-invariant state predictor with differentiable simulation and rendering for cross-domain parameter estimation. arXiv preprint arXiv:2205.05678, 2022.
  60. Macklin, M. Warp: A high-performance python framework for gpu simulation and graphics. https://github.com/nvidia/warp, March 2022. NVIDIA GPU Technology Conference (GTC).
  61. Characteristics of dough rheology and the structural, mechanical, and sensory properties of sponge cakes with sweeteners. Molecules, 26(21):6638, 2021.
  62. Mises, R. v. Mechanik der festen körper im plastisch-deformablen zustand. Nachrichten von der Gesellschaft der Wissenschaften zu Göttingen, Mathematisch-Physikalische Klasse, 1913:582–592, 1913.
  63. Monaghan, J. J. Smoothed particle hydrodynamics. Annual review of astronomy and astrophysics, 30:543–574, 1992.
  64. gradsim: Differentiable simulation for system identification and visuomotor control. In International Conference on Learning Representations, 2020.
  65. Ogden, R. W. Non-linear elastic deformations. Courier Corporation, 1997.
  66. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32, 2019.
  67. Learning mesh-based simulation with graph networks. arXiv preprint arXiv:2010.03409, 2020.
  68. Differentiable simulation of soft multi-body systems. Advances in Neural Information Processing Systems, 34:17123–17135, 2021a.
  69. Efficient differentiable simulation of articulated bodies. In International Conference on Machine Learning, pp. 8661–8671. PMLR, 2021b.
  70. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378:686–707, 2019.
  71. Learning to simulate complex physics with graph networks. In International Conference on Machine Learning, pp. 8459–8468. PMLR, 2020.
  72. Finite element analysis of v-ribbed belts using neural network based hyperelastic material model. International Journal of Non-Linear Mechanics, 40(6):875–890, 2005.
  73. Energetically consistent invertible elasticity. In Symposium on Computer Animation, volume 1, 2012.
  74. A material point method for snow simulation. ACM Transactions on Graphics (TOG), 32(4):1–10, 2013.
  75. Augmented mpm for phase-change and varied materials. ACM Transactions on Graphics (TOG), 33(4):1–11, 2014.
  76. Application of a particle-in-cell method to solid mechanics. Computer physics communications, 87(1-2):236–252, 1995.
  77. Data-driven discovery of interpretable causal relations for deep learning material laws with uncertainty propagation. Granular Matter, 24(1):1–32, 2022.
  78. Multi-species simulation of porous sand and water mixtures. ACM Transactions on Graphics (TOG), 36(4):1–11, 2017.
  79. Learning parameters and constitutive relationships with physics informed deep neural networks. arXiv preprint arXiv:1808.03398, 2018.
  80. Thompson, J. O. Hooke’s law. Science, 64(1656):298–299, 1926.
  81. Treloar, L. The elasticity of a network of long-chain molecules. i. Transactions of the Faraday Society, 39:36–41, 1943.
  82. Springer handbook of experimental fluid mechanics, volume 1. Springer, 2007.
  83. The non-linear field theories of mechanics. In The non-linear field theories of mechanics, pp.  1–579. Springer, 2004.
  84. Solver-in-the-loop: Learning from differentiable physics to interact with iterative pde-solvers. Advances in Neural Information Processing Systems, 33:6111–6122, 2020.
  85. Sobolev training of thermodynamic-informed neural networks for interpretable elasto-plasticity models with level set hardening. Computer Methods in Applied Mechanics and Engineering, 377:113695, 2021.
  86. Component-based machine learning paradigm for discovering rate-dependent and pressure-sensitive level-set plasticity models. Journal of Applied Mechanics, 89(2), 2022a.
  87. Geometric deep learning for computational mechanics part ii: Graph embedding for interpretable multiscale plasticity. arXiv preprint arXiv:2208.00246, 2022b.
  88. Geometric deep learning for computational mechanics part i: anisotropic hyperelasticity. Computer Methods in Applied Mechanics and Engineering, 371:113299, 2020.
  89. Molecular dynamics inferred transfer learning models for finite-strain hyperelasticity of monoclinic crystals: Sobolev training and validations against physical constraints. International Journal for Numerical Methods in Engineering, 2022.
  90. Learning elastic constitutive material and damping models. In Computer Graphics Forum, volume 39, pp.  81–91. Wiley Online Library, 2020.
  91. A multiscale multi-permeability poroplasticity model linked by recursive homogenizations and deep learning. Computer Methods in Applied Mechanics and Engineering, 334:337–380, 2018.
  92. Softzoo: A soft robot co-design benchmark for locomotion in diverse environments. In The Eleventh International Conference on Learning Representations, 2023.
  93. Fluidlab: A differentiable environment for benchmarking complex fluid manipulation. arXiv preprint arXiv:2303.02346, 2023.
  94. Example-based damping design. ACM Transactions on Graphics (TOG), 36(4):1–14, 2017.
  95. Nonlinear material design using principal stretches. ACM Transactions on Graphics (TOG), 34(4):1–11, 2015.
  96. Augmenting physical models with deep networks for complex dynamics forecasting. Journal of Statistical Mechanics: Theory and Experiment, 2021(12):124012, 2021.
  97. Continuum foam: A material point method for shear-dependent flows. ACM Transactions on Graphics (TOG), 34(5):1–20, 2015.
  98. Hybrid grains: Adaptive coupling of discrete and continuum simulations of granular media. ACM Transactions on Graphics (TOG), 37(6):1–19, 2018.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (7)
  1. Pingchuan Ma (91 papers)
  2. Peter Yichen Chen (16 papers)
  3. Bolei Deng (12 papers)
  4. Joshua B. Tenenbaum (257 papers)
  5. Tao Du (33 papers)
  6. Chuang Gan (196 papers)
  7. Wojciech Matusik (76 papers)
Citations (25)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com