ContourCraft: Learning to Resolve Intersections in Neural Multi-Garment Simulations (2405.09522v2)
Abstract: Learning-based approaches to cloth simulation have started to show their potential in recent years. However, handling collisions and intersections in neural simulations remains a largely unsolved problem. In this work, we present \moniker{}, a learning-based solution for handling intersections in neural cloth simulations. Unlike conventional approaches that critically rely on intersection-free inputs, \moniker{} robustly recovers from intersections introduced through missed collisions, self-penetrating bodies, or errors in manually designed multi-layer outfits. The technical core of \moniker{} is a novel intersection contour loss that penalizes interpenetrations and encourages rapid resolution thereof. We integrate our intersection loss with a collision-avoiding repulsion objective into a neural cloth simulation method based on graph neural networks (GNNs). We demonstrate our method's ability across a challenging set of diverse multi-layer outfits under dynamic human motions. Our extensive analysis indicates that \moniker{} significantly improves collision handling for learned simulation and produces visually compelling results.
- Untangling cloth. ACM Transactions on Graphics (TOG) 22, 3 (2003), 862–870.
- PBNS: physically based neural simulator for unsupervised garment pose space deformation. arXiv preprint arXiv:2012.11310 (2020).
- Neural Cloth Simulation. ACM Transactions on Graphics (TOG) 41, 6 (2022), 1–14.
- BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motion. In Proceedings IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR).
- Robust treatment of collisions, contact and friction for cloth animation. In Proceedings of the 29th annual conference on Computer graphics and interactive techniques. 594–603.
- Implicit untangling: A robust solution for modeling layered clothing. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1–12.
- Ick-Hoon Cha and Hyeong-Seok Ko. 2020. Tanglement resolution in clothing simulation with explicit convergence. IEEE Transactions on Visualization and Computer Graphics 28, 7 (2020), 2764–2775.
- CLO Virtual Fashion. 2022. Clo3D. CLO Virtual Fashion. https://clo3d.com/en/ Computer Software.
- Latent-space Dynamics for Reduced Deformable Simulation. Computer Graphics Forum (2019).
- HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics. IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR).
- Drape: Dressing any person. ACM Transactions on Graphics (ToG) 31, 4 (2012), 1–10.
- Asynchronous contact mechanics. ACM Transactions on Graphics 28 (7 2009). Issue 3. https://doi.org/10.1145/1531326.1531393
- Robust treatment of simultaneous collisions. In ACM SIGGRAPH 2008 papers. 1–4.
- Subspace Neural Physics: Fast Data-Driven Interactive Simulation. In Proceedings of the 18th Annual ACM SIGGRAPH/Eurographics Symposium on Computer Animation (Los Angeles, California) (SCA ’19). Association for Computing Machinery, New York, NY, USA, Article 6, 12 pages. https://doi.org/10.1145/3309486.3340245
- Tero Karras. 2012. Maximizing parallelism in the construction of BVHs, octrees, and k-d trees. In Proceedings of the Fourth ACM SIGGRAPH/Eurographics conference on High-Performance Graphics. 33–37.
- Incremental potential contact: intersection-and inversion-free, large-deformation dynamics. ACM Trans. Graph. 39, 4 (2020), 49.
- AMASS: Archive of motion capture as surface shapes. In Proceedings of the IEEE/CVF international conference on computer vision. 5442–5451.
- Example-Based Elastic Materials. ACM Trans. Graph. 30, 4, Article 72 (jul 2011), 8 pages. https://doi.org/10.1145/2010324.1964967
- Expressive Body Capture: 3D Hands, Face, and Body from a Single Image. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR).
- Learning mesh-based simulation with graph networks. arXiv preprint arXiv:2010.03409 (2020).
- Learning Mesh-Based Simulation with Graph Networks. In International Conference on Learning Representations.
- Learning Contact Corrections for Handle-Based Subspace Dynamics. ACM Trans. Graph. 40, 4, Article 131 (jul 2021), 12 pages. https://doi.org/10.1145/3450626.3459875
- Ulnef: Untangled layered neural fields for mix-and-match virtual try-on. Advances in Neural Information Processing Systems 35 (2022), 12110–12125.
- Learning-based animation of clothing for virtual try-on. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 355–366.
- Snug: Self-supervised neural dynamic garments. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8140–8150.
- Self-supervised collision handling via generative 3d garment models for virtual try-on. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11763–11773.
- Towards Multi-Layered 3D Garments Animation. arXiv preprint arXiv:2305.10418 (2023).
- Data-Free Learning of Reduced-Order Kinematics. In ACM SIGGRAPH 2023 Conference Proceedings (¡conf-loc¿, ¡city¿Los Angeles¡/city¿, ¡state¿CA¡/state¿, ¡country¿USA¡/country¿, ¡/conf-loc¿) (SIGGRAPH ’23). Association for Computing Machinery, New York, NY, USA, Article 40, 9 pages. https://doi.org/10.1145/3588432.3591521
- High-Order Differentiable Autoencoder for Nonlinear Model Reduction. ACM Trans. Graph. 40, 4, Article 68 (jul 2021), 15 pages. https://doi.org/10.1145/3450626.3459754
- A Repulsive Force Unit for Garment Collision Handling in Neural Networks. In Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part III. Springer, 451–467.
- PSCC: Parallel self-collision culling with spatial hashing on GPUs. Proceedings of the ACM on Computer Graphics and Interactive Techniques 1, 1 (2018), 1–18.
- Collision-streams: Fast GPU-based collision detection for deformable models. In Symposium on interactive 3D graphics and games. 63–70.
- A GPU-based streaming algorithm for high-resolution cloth simulation. In Computer Graphics Forum, Vol. 32. Wiley Online Library, 21–30.
- I-Cloth: Incremental collision handling for GPU-based interactive cloth simulation. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1–10.
- Collision detection for deformable objects. In Computer graphics forum, Vol. 24. Wiley Online Library, 61–81.
- Pascal Volino and Nadia Magnenat-Thalmann. 2006. Resolving surface collisions through intersection contour minimization. ACM Transactions on Graphics (TOG) 25, 3 (2006), 1154–1159.
- Huamin Wang. 2021. GPU-based simulation of cloth wrinkles at submillimeter levels. ACM Transactions on Graphics (TOG) 40, 4 (2021), 1–14.
- Neural Modes: Self-supervised Learning of Nonlinear Modal Subspaces. IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR).
- Efficient and Reliable Self-Collision Culling Using Unprojected Normal Cones. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 487–498.
- A safe and fast repulsion method for GPU-based cloth self collisions. ACM Transactions on Graphics (TOG) 40, 1 (2020), 1–18.
- A unified cloth untangling framework through discrete collision detection. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 217–228.
- Fast discrete intersection detection for cloth penetration resolution. In 2015 IEEE International Conference on Multimedia Big Data. IEEE, 352–357.
- Juntao Ye and Jing Zhao. 2012. The intersection contour minimization method for untangling oriented deformable surfaces. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 311–316.
- Yueqi Zhong. 2009. Fast penetration resolving for multi-layered virtual garment dressing. Textile Research Journal 79, 9 (2009), 815–821.