Papers
Topics
Authors
Recent
2000 character limit reached

DeepFracture: A Generative Approach for Predicting Brittle Fractures with Neural Discrete Representation Learning (2310.13344v2)

Published 20 Oct 2023 in cs.GR and cs.CV

Abstract: In the field of brittle fracture animation, generating realistic destruction animations using physics-based simulation methods is computationally expensive. While techniques based on Voronoi diagrams or pre-fractured patterns are effective for real-time applications, they fail to incorporate collision conditions when determining fractured shapes during runtime. This paper introduces a novel learning-based approach for predicting fractured shapes based on collision dynamics at runtime. Our approach seamlessly integrates realistic brittle fracture animations with rigid body simulations, utilising boundary element method (BEM) brittle fracture simulations to generate training data. To integrate collision scenarios and fractured shapes into a deep learning framework, we introduce generative geometric segmentation, distinct from both instance and semantic segmentation, to represent 3D fragment shapes. We propose an eight-dimensional latent code to address the challenge of optimising multiple discrete fracture pattern targets that share similar continuous collision latent codes. This code will follow a discrete normal distribution corresponding to a specific fracture pattern within our latent impulse representation design. This adaptation enables the prediction of fractured shapes using neural discrete representation learning. Our experimental results show that our approach generates considerably more detailed brittle fractures than existing techniques, while the computational time is typically reduced compared to traditional simulation methods at comparable resolutions.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. Wasserstein generative adversarial networks. In Proc. 34th International Conference on Machine Learning, pages 214–223. JMLR.org, 2017.
  2. Voronoi diagrams. In Handbook of Computational Geometry, chapter 5, pages 201–290. North-Holland, Amsterdam, 2000.
  3. Fracturing rigid materials. IEEE Transactions on Visualization & Computer Graphics, 13(2):370–378, 2007.
  4. Displacement-correlated XFEM for simulating brittle fracture. Computer Graphics Forum, 39(2):569–583, 2020.
  5. Erwin Coumans. Bullet physics simulation. In ACM SIGGRAPH 2015 Courses. ACM, New York, NY, USA, 2015.
  6. Simulating brittle fracture with material points. ACM Transactions on Graphics (TOG), 41(5):1–20, 2022.
  7. Improved training of Wasserstein GANs. In Advances in Neural Information Processing Systems, pages 5769––5779. Curran Associates, Inc., Red Hook, NY, USA, 2017.
  8. Improved modeling of 3D shapes with multi-view depth maps. In 2020 International Conference on 3D Vision (3DV), pages 71–80. IEEE Computer Society, Los Alamitos, CA, USA, 2020.
  9. High-resolution brittle fracture simulation with boundary elements. ACM Trans. Graph., 34(4), 2015.
  10. Fast approximations for boundary element based brittle fracture simulation. ACM Trans. Graph., 35(4), 2016.
  11. Geometric fracture modeling in Bolt. In SIGGRAPH 2009: Talks. ACM, New York, NY, USA, 2009.
  12. Predicting brittle fracture surface shape from a versatile database. Computer Animation and Virtual Worlds, 30(6):e1865, 2019.
  13. A fast method for simulating destruction and the generated dust and debris. The Visual Computer, 25(5-7):719–727, 2009a.
  14. A method to control the shape of destroyed objects in destruction simulation. Journal of the Institute of Image Electronics Engineers of Japan, 38(4):449–458, 2009b.
  15. Image-to-image translation with conditional adversarial networks. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pages 5967–5976. IEEE Computer Society, Los Alamitos, CA, USA, 2017.
  16. DeepJoin: Learning a joint occupancy, signed distance, and normal field function for shape repair. ACM Trans. Graph., 41(6), 2022a.
  17. MendNet: Restoration of fractured shapes using learned occupancy functions. Computer Graphics Forum, 41(5):65–78, 2022b.
  18. Fantastic breaks: A dataset of paired 3D scans of real-world broken objects and their complete counterparts. In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4681–4691, 2023.
  19. MorphoLibJ: Integrated library and plugins for mathematical morphology with ImageJ. Bioinformatics, 32(22):3532–3534, 2016.
  20. Meshless simulation of brittle fracture. Computer Animation and Virtual Worlds, 22(2-3):115–124, 2011.
  21. Remeshing-free graph-based finite element method for fracture simulation. Computer Graphics Forum, 42(1):117–134, 2023.
  22. Animating exploding objects. In Proc. Graphics Interface, pages 211–218. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1999.
  23. NeRF: Representing scenes as neural radiance fields for view synthesis. In Proc. 16th European Conference on Computer Vision Part I, pages 405––421. Springer-Verlag, Berlin, Heidelberg, 2020.
  24. Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784, 2014.
  25. Real time dynamic fracture with volumetric approximate convex decompositions. ACM Trans. Graph., 32(4), 2013.
  26. A visual model for blast waves and fracture. In Proc. Graphics Interface, pages 193–202. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1999.
  27. Animation of fracture by physical modeling. The Visual Computer, 7(4):210–219, 1991.
  28. Graphical modeling and animation of brittle fracture. In Proc. ACM SIGGRAPH ’99, pages 137–146. ACM, New York, NY, USA, 1999.
  29. Graphical modeling and animation of ductile fracture. ACM Trans. Graph., 21(3):291–294, 2002.
  30. DeepSDF: Learning continuous signed distance functions for shape representation. In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 165–174, 2019.
  31. PhysXSDK. NVIDIA PhysX SDK. https://developer.nvidia.com/physx-sdk. Accessed: 2nd October, 2023.
  32. Saty Raghavachary. Fracture generation on polygonal meshes using Voronoi polygons. In ACM SIGGRAPH 2002 Conference Abstracts and Applications, pages 187–187. ACM, New York, NY, USA, 2002.
  33. Fracture animation based on high-dimensional Voronoi diagrams. In Proc. 18th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, pages 15–22. ACM, New York, NY, USA, 2014.
  34. Breaking bad: A dataset for geometric fracture and reassembly. In Advances in Neural Information Processing Systems, pages 38885–38898. Curran Associates, Inc., Red Hook, NY, USA, 2022.
  35. Breaking good: Fracture modes for realtime destruction. ACM Trans. Graph., 42(1), 2023.
  36. Implicit neural representations with periodic activation functions. In Advances in Neural Information Processing Systems, pages 7462–7473. Curran Associates, Inc., Red Hook, NY, USA, 2020.
  37. Energy stability and fracture for frame rate rigid body simulations. In Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pages 155–164. ACM SIGGRAPH / Eurographics Association, 2009.
  38. Modeling inelastic deformation: Viscolelasticity, plasticity, fracture. SIGGRAPH Comput. Graph., 22(4):269–278, 1988.
  39. A novel deep learning-based 3D cell segmentation framework for future image-based disease detection. Scientific Reports, 12(1):342, 2022.
  40. Learning a probabilistic latent space of object shapes via 3D generative-adversarial modeling. In Advances in Neural Information Processing Systems, pages 82–90. Curran Associates, Inc., Red Hook, NY, USA, 2016.
  41. Thingi10k: A dataset of 10,000 3D-printing models. arXiv preprint arXiv:1605.04797, 2016.

Summary

We haven't generated a summary for this paper yet.

Whiteboard

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.