Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

ContourCraft: Learning to Resolve Intersections in Neural Multi-Garment Simulations (2405.09522v2)

Published 15 May 2024 in cs.GR and cs.LG

Abstract: Learning-based approaches to cloth simulation have started to show their potential in recent years. However, handling collisions and intersections in neural simulations remains a largely unsolved problem. In this work, we present \moniker{}, a learning-based solution for handling intersections in neural cloth simulations. Unlike conventional approaches that critically rely on intersection-free inputs, \moniker{} robustly recovers from intersections introduced through missed collisions, self-penetrating bodies, or errors in manually designed multi-layer outfits. The technical core of \moniker{} is a novel intersection contour loss that penalizes interpenetrations and encourages rapid resolution thereof. We integrate our intersection loss with a collision-avoiding repulsion objective into a neural cloth simulation method based on graph neural networks (GNNs). We demonstrate our method's ability across a challenging set of diverse multi-layer outfits under dynamic human motions. Our extensive analysis indicates that \moniker{} significantly improves collision handling for learned simulation and produces visually compelling results.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. Untangling cloth. ACM Transactions on Graphics (TOG) 22, 3 (2003), 862–870.
  2. PBNS: physically based neural simulator for unsupervised garment pose space deformation. arXiv preprint arXiv:2012.11310 (2020).
  3. Neural Cloth Simulation. ACM Transactions on Graphics (TOG) 41, 6 (2022), 1–14.
  4. BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motion. In Proceedings IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR).
  5. Robust treatment of collisions, contact and friction for cloth animation. In Proceedings of the 29th annual conference on Computer graphics and interactive techniques. 594–603.
  6. Implicit untangling: A robust solution for modeling layered clothing. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1–12.
  7. Ick-Hoon Cha and Hyeong-Seok Ko. 2020. Tanglement resolution in clothing simulation with explicit convergence. IEEE Transactions on Visualization and Computer Graphics 28, 7 (2020), 2764–2775.
  8. CLO Virtual Fashion. 2022. Clo3D. CLO Virtual Fashion. https://clo3d.com/en/ Computer Software.
  9. Latent-space Dynamics for Reduced Deformable Simulation. Computer Graphics Forum (2019).
  10. HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics. IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR).
  11. Drape: Dressing any person. ACM Transactions on Graphics (ToG) 31, 4 (2012), 1–10.
  12. Asynchronous contact mechanics. ACM Transactions on Graphics 28 (7 2009). Issue 3. https://doi.org/10.1145/1531326.1531393
  13. Robust treatment of simultaneous collisions. In ACM SIGGRAPH 2008 papers. 1–4.
  14. Subspace Neural Physics: Fast Data-Driven Interactive Simulation. In Proceedings of the 18th Annual ACM SIGGRAPH/Eurographics Symposium on Computer Animation (Los Angeles, California) (SCA ’19). Association for Computing Machinery, New York, NY, USA, Article 6, 12 pages. https://doi.org/10.1145/3309486.3340245
  15. Tero Karras. 2012. Maximizing parallelism in the construction of BVHs, octrees, and k-d trees. In Proceedings of the Fourth ACM SIGGRAPH/Eurographics conference on High-Performance Graphics. 33–37.
  16. Incremental potential contact: intersection-and inversion-free, large-deformation dynamics. ACM Trans. Graph. 39, 4 (2020), 49.
  17. AMASS: Archive of motion capture as surface shapes. In Proceedings of the IEEE/CVF international conference on computer vision. 5442–5451.
  18. Example-Based Elastic Materials. ACM Trans. Graph. 30, 4, Article 72 (jul 2011), 8 pages. https://doi.org/10.1145/2010324.1964967
  19. Expressive Body Capture: 3D Hands, Face, and Body from a Single Image. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR).
  20. Learning mesh-based simulation with graph networks. arXiv preprint arXiv:2010.03409 (2020).
  21. Learning Mesh-Based Simulation with Graph Networks. In International Conference on Learning Representations.
  22. Learning Contact Corrections for Handle-Based Subspace Dynamics. ACM Trans. Graph. 40, 4, Article 131 (jul 2021), 12 pages. https://doi.org/10.1145/3450626.3459875
  23. Ulnef: Untangled layered neural fields for mix-and-match virtual try-on. Advances in Neural Information Processing Systems 35 (2022), 12110–12125.
  24. Learning-based animation of clothing for virtual try-on. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 355–366.
  25. Snug: Self-supervised neural dynamic garments. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8140–8150.
  26. Self-supervised collision handling via generative 3d garment models for virtual try-on. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11763–11773.
  27. Towards Multi-Layered 3D Garments Animation. arXiv preprint arXiv:2305.10418 (2023).
  28. Data-Free Learning of Reduced-Order Kinematics. In ACM SIGGRAPH 2023 Conference Proceedings (¡conf-loc¿, ¡city¿Los Angeles¡/city¿, ¡state¿CA¡/state¿, ¡country¿USA¡/country¿, ¡/conf-loc¿) (SIGGRAPH ’23). Association for Computing Machinery, New York, NY, USA, Article 40, 9 pages. https://doi.org/10.1145/3588432.3591521
  29. High-Order Differentiable Autoencoder for Nonlinear Model Reduction. ACM Trans. Graph. 40, 4, Article 68 (jul 2021), 15 pages. https://doi.org/10.1145/3450626.3459754
  30. A Repulsive Force Unit for Garment Collision Handling in Neural Networks. In Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part III. Springer, 451–467.
  31. PSCC: Parallel self-collision culling with spatial hashing on GPUs. Proceedings of the ACM on Computer Graphics and Interactive Techniques 1, 1 (2018), 1–18.
  32. Collision-streams: Fast GPU-based collision detection for deformable models. In Symposium on interactive 3D graphics and games. 63–70.
  33. A GPU-based streaming algorithm for high-resolution cloth simulation. In Computer Graphics Forum, Vol. 32. Wiley Online Library, 21–30.
  34. I-Cloth: Incremental collision handling for GPU-based interactive cloth simulation. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1–10.
  35. Collision detection for deformable objects. In Computer graphics forum, Vol. 24. Wiley Online Library, 61–81.
  36. Pascal Volino and Nadia Magnenat-Thalmann. 2006. Resolving surface collisions through intersection contour minimization. ACM Transactions on Graphics (TOG) 25, 3 (2006), 1154–1159.
  37. Huamin Wang. 2021. GPU-based simulation of cloth wrinkles at submillimeter levels. ACM Transactions on Graphics (TOG) 40, 4 (2021), 1–14.
  38. Neural Modes: Self-supervised Learning of Nonlinear Modal Subspaces. IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR).
  39. Efficient and Reliable Self-Collision Culling Using Unprojected Normal Cones. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 487–498.
  40. A safe and fast repulsion method for GPU-based cloth self collisions. ACM Transactions on Graphics (TOG) 40, 1 (2020), 1–18.
  41. A unified cloth untangling framework through discrete collision detection. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 217–228.
  42. Fast discrete intersection detection for cloth penetration resolution. In 2015 IEEE International Conference on Multimedia Big Data. IEEE, 352–357.
  43. Juntao Ye and Jing Zhao. 2012. The intersection contour minimization method for untangling oriented deformable surfaces. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 311–316.
  44. Yueqi Zhong. 2009. Fast penetration resolving for multi-layered virtual garment dressing. Textile Research Journal 79, 9 (2009), 815–821.
Citations (2)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

Youtube Logo Streamline Icon: https://streamlinehq.com