Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Neural Modes: Self-supervised Learning of Nonlinear Modal Subspaces (2404.17620v1)

Published 26 Apr 2024 in cs.LG, cs.CV, and cs.GR

Abstract: We propose a self-supervised approach for learning physics-based subspaces for real-time simulation. Existing learning-based methods construct subspaces by approximating pre-defined simulation data in a purely geometric way. However, this approach tends to produce high-energy configurations, leads to entangled latent space dimensions, and generalizes poorly beyond the training set. To overcome these limitations, we propose a self-supervised approach that directly minimizes the system's mechanical energy during training. We show that our method leads to learned subspaces that reflect physical equilibrium constraints, resolve overfitting issues of previous methods, and offer interpretable latent space parameters.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. Sharjeel Ali and Oliver van Kaick. Evaluation of latent space learning with procedurally-generated datasets of shapes. Computer Vision and Pattern Recognition (CVPR), 2021.
  2. Real-time subspace integration for St. Venant-Kirchhoff deformable models. ACM Trans. Graph., 24(3):982–990, 2005.
  3. Deformable object animation using reduced optimal control. ACM Trans. Graph., 28(3), 2009.
  4. Neural cloth simulation. ACM Trans. Graph., 41(6), 2022.
  5. Modal warping: Real-time simulation of large rotational deformation and manipulation. IEEE Transactions on Visualization and Computer Graphics, 11(1):91–101, 2005.
  6. N-cloth: Predicting 3d cloth deformation with mesh-based networks. In Computer Graphics Forum, pages 547–558. Wiley Online Library, 2022.
  7. Nonlinear compliant modes for large-deformation analysis of flexible structures. ACM Trans. Graph., 42(2), 2022.
  8. Latent-space dynamics for reduced deformable simulation. Computer Graphics Forum, 2019.
  9. Hood: Hierarchical graphs for generalized modelling of clothing dynamics. Computer Vision and Pattern Recognition (CVPR), 2023.
  10. Discrete shells. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, pages 62–67. Citeseer, 2003.
  11. Rig-space physics. ACM Trans. Graph., 31(4), 2012.
  12. Efficient simulation of secondary motion in rig-space. In Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation, page 165–171, New York, NY, USA, 2013. Association for Computing Machinery.
  13. Subspace clothing simulation using adaptive bases. ACM Trans. Graph., 33(4), 2014.
  14. Interactive surface modeling using modal analysis. ACM Trans. Graph., 30(5), 2011.
  15. Subspace neural physics: Fast data-driven interactive simulation. In Proceedings of the 18th Annual ACM SIGGRAPH/Eurographics Symposium on Computer Animation, New York, NY, USA, 2019. Association for Computing Machinery.
  16. Interactive shape interpolation through controllable dynamic deformation. IEEE Transactions on Visualization and Computer Graphics, 17(7):983–992, 2011.
  17. Dynamic deformables: Implementation and production practicalities (now with code!). In ACM SIGGRAPH 2022 Courses, New York, NY, USA, 2022. Association for Computing Machinery.
  18. M.A. Kramer. Autoassociative neural networks. Computers & Chemical Engineering, 16(4):313–328, 1992. Neutral network applications in chemical engineering.
  19. Enhanced rig-space simulation. Computer Animation and Virtual Worlds, 27(3-4):250–261, 2016.
  20. Subspace-preconditioned gpu projective dynamics with contact for cloth simulation. In SIGGRAPH Asia 2023 Conference Papers, New York, NY, USA, 2023. Association for Computing Machinery.
  21. Meshgraphnetrp: Improving generalization of gnn-based cloth simulation. In Proceedings of the 16th ACM SIGGRAPH Conference on Motion, Interaction and Games, New York, NY, USA, 2023. Association for Computing Machinery.
  22. On the limited memory bfgs method for large scale optimization. Mathematical programming, 45(1-3):503–528, 1989.
  23. Example-based elastic materials. In ACM SIGGRAPH 2011 Papers, New York, NY, USA, 2011. Association for Computing Machinery.
  24. Reduced basis technique for nonlinear analysis of structures. Aiaa journal, 18(4):455–462, 1980.
  25. Hierarchical cloth simulation using deep neural networks. In Proceedings of Computer Graphics International 2018, page 139–146, New York, NY, USA, 2018. Association for Computing Machinery.
  26. Physik: Physically plausible and intuitive keyframing. In Proceedings of the 42nd Graphics Interface Conference, page 153–161, Waterloo, CAN, 2016. Canadian Human-Computer Communications Society.
  27. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics, 378:686–707, 2019.
  28. Learning contact corrections for handle-based subspace dynamics. ACM Trans. Graph., 40(4), 2021.
  29. Snug: Self-supervised neural dynamic garments. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8140–8150, 2022.
  30. Efficient simulation of example-based materials. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, page 1–8, Goslar, DEU, 2012. Eurographics Association.
  31. Ahmed A Shabana. Theory of vibration. Springer, 1991.
  32. Data-free learning of reduced-order kinematics, 2023.
  33. High-order differentiable autoencoder for nonlinear model reduction. ACM Trans. Graph., 40(4), 2021.
  34. Demea: Deep mesh autoencoders for non-rigidly deforming objects. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part IV 16, pages 601–617. Springer, 2020.
  35. A data-driven reduced-order surrogate model for entire elastoplastic simulations applied to representative volume elements. Scientific Reports, 13(1):12781, 2023.
  36. Learning an intrinsic garment space for interactive authoring of garment animation. ACM Trans. Graph., 38(6), 2019.
  37. Pose-space subspace dynamics. ACM Trans. Graph., 35(4), 2016.
  38. Expediting precomputation for reduced deformable simulation. ACM Trans. Graph., 34(6), 2015.

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com
Youtube Logo Streamline Icon: https://streamlinehq.com