Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
GPT-5.1
GPT-5.1 114 tok/s
Gemini 3.0 Pro 53 tok/s Pro
Gemini 2.5 Flash 132 tok/s Pro
Kimi K2 176 tok/s Pro
Claude Sonnet 4.5 37 tok/s Pro
2000 character limit reached

A Neural-Network-Based Approach for Loose-Fitting Clothing (2404.16896v1)

Published 25 Apr 2024 in cs.GR and cs.LG

Abstract: Since loose-fitting clothing contains dynamic modes that have proven to be difficult to predict via neural networks, we first illustrate how to coarsely approximate these modes with a real-time numerical algorithm specifically designed to mimic the most important ballistic features of a classical numerical simulation. Although there is some flexibility in the choice of the numerical algorithm used as a proxy for full simulation, it is essential that the stability and accuracy be independent from any time step restriction or similar requirements in order to facilitate real-time performance. In order to reduce the number of degrees of freedom that require approximations to their dynamics, we simulate rigid frames and use skinning to reconstruct a rough approximation to a desirable mesh; as one might expect, neural-network-based skinning seems to perform better than linear blend skinning in this scenario. Improved high frequency deformations are subsequently added to the skinned mesh via a quasistatic neural network (QNN). In contrast to recurrent neural networks that require a plethora of training data in order to adequately generalize to new examples, QNNs perform well with significantly less training data.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (79)
  1. Scape: shape completion and animation of people. In ACM SIGGRAPH 2005 Papers. 408–416.
  2. Fast and deep facial deformations. ACM Transactions on Graphics (TOG) 39, 4 (2020), 94–1.
  3. Fast and deep deformation approximations. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1–12.
  4. David Baraff and Andrew Witkin. 1998. Large steps in cloth simulation. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques. 43–54.
  5. PBNS: physically based neural simulation for unsupervised garment pose space deformation. ACM Trans. Graph. 40, 6 (2021), 198:1–198:14. https://doi.org/10.1145/3478513.3480479
  6. DeePSD: Automatic deep skinning and pose space deformation for 3D garment animation. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 5471–5480.
  7. James F Blinn. 1982. A generalization of algebraic surface drawing. ACM transactions on graphics (TOG) 1, 3 (1982), 235–256.
  8. Robust treatment of collisions, contact and friction for cloth animation. In Proceedings of the 29th annual conference on Computer graphics and interactive techniques. 594–603.
  9. Simulation of Clothing with Folds and Wrinkles. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (San Diego, California) (SCA ’03). Eurographics Association, Goslar, DEU, 28–36.
  10. Cloth and skin deformation with a triangle mesh based convolutional neural network. In Computer Graphics Forum, Vol. 39. Wiley Online Library, 123–134.
  11. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014).
  12. Kwang-Jin Choi and Hyeong-Seok Ko. 2002. Stable but Responsive Cloth. ACM Trans. Graph. 21, 3 (July 2002), 604–611.
  13. Stable spaces for real-time clothing. ACM Transactions on Graphics (ToG) 29, 4 (2010), 1–9.
  14. Combating Spurious Correlations in Loose-fitting Garment Animation Through Joint-Specific Feature Learning. In Computer Graphics Forum, Vol. 42. Wiley Online Library, e14939.
  15. Latent-space dynamics for reduced deformable simulation. In Computer graphics forum, Vol. 38. Wiley Online Library, 379–391.
  16. Interactive collision detection between deformable models using chromatic decomposition. ACM Transactions on graphics (TOG) 24, 3 (2005), 991–999.
  17. HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 16965–16974.
  18. Drape: Dressing any person. ACM Transactions on Graphics (ToG) 31, 4 (2012), 1–10.
  19. Nonconvex rigid bodies with stacking. ACM transactions on graphics (TOG) 22, 3 (2003), 871–878.
  20. Garnet: A two-stream network for fast and accurate 3d cloth draping. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 8739–8748.
  21. Subspace clothing simulation using adaptive bases. ACM Transactions on Graphics (TOG) 33, 4 (2014), 1–9.
  22. Subspace neural physics: Fast data-driven interactive simulation. In Proceedings of the 18th annual ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 1–12.
  23. Inequality cloth. In Proceedings of the ACM SIGGRAPH/Eurographics symposium on computer animation. 1–10.
  24. A pixel-based framework for data-driven clothing. In Computer Graphics Forum, Vol. 39. Wiley Online Library, 135–144.
  25. Analytically Integratable Zero-restlength Springs for Capturing Dynamic Modes unrepresented by Quasistatic Neural Networks. In ACM SIGGRAPH 2022 Conference Proceedings. 1–9.
  26. Skinning with dual quaternions. In Proceedings of the 2007 symposium on Interactive 3D graphics and games. 39–46.
  27. Geometric skinning with approximate dual quaternion blending. ACM Transactions on Graphics (TOG) 27, 4 (2008), 1–23.
  28. Physics-inspired upsampling for cloth simulation in games. In ACM SIGGRAPH 2011 papers. 1–10.
  29. Near-exhaustive precomputation of secondary cloth effects. ACM Transactions on Graphics (TOG) 32, 4 (2013), 1–8.
  30. Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
  31. Tsuneya Kurihara and Natsuki Miyata. 2004. Modeling deformable human hands from medical images. In Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation. 355–363.
  32. Deepwrinkles: Accurate and realistic clothing modeling. In Proceedings of the European conference on computer vision (ECCV). 667–684.
  33. Binh Huy Le and Zhigang Deng. 2012. Smooth skinning decomposition with rigid bones. ACM Transactions on Graphics (TOG) 31, 6 (2012), 1–10.
  34. ClothCombo: Modeling Inter-Cloth Interaction for Draping Multi-Layered Clothes. ACM Transactions on Graphics (TOG) 42, 6 (2023), 1–13.
  35. Christopher Lewin. 2021. Swish: Neural Network Cloth Simulation on Madden NFL 21. In ACM SIGGRAPH 2021 Talks. 1–2.
  36. Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques 2000. ACM Press/Addison-Wesley Publishing Co., 165–172.
  37. P-cloth: interactive complex cloth simulation on multi-GPU systems using dynamic matrix assembly and pipelined implicit integrators. ACM Transactions on Graphics (TOG) 39, 6 (2020), 1–15.
  38. Isp: Multi-layered garment draping with implicit sewing patterns. Advances in Neural Information Processing Systems 36 (2024).
  39. D-Cloth: Skinning-based Cloth Dynamic Prediction with a Three-stage Network. In Computer Graphics Forum, Vol. 42. Wiley Online Library, e14937.
  40. N-Cloth: Predicting 3D Cloth Deformation with Mesh-Based Networks. In Computer Graphics Forum, Vol. 41. Wiley Online Library, 547–558.
  41. SMPL: a skinned multi-person linear model. ACM Trans. Graph. 34, 6, Article 248 (oct 2015), 16 pages. https://doi.org/10.1145/2816795.2818013
  42. NNWarp: Neural network-based nonlinear deformation. IEEE transactions on visualization and computer graphics 26, 4 (2018), 1745–1759.
  43. Joint-dependent local deformations for hand animation and object grasping. Technical Report. Canadian Inf. Process. Soc.
  44. A level set theory for neural implicit evolution under explicit flows. In European Conference on Computer Vision. Springer, 711–729.
  45. Position based dynamics. Journal of Visual Communication and Image Representation 18, 2 (2007), 109–118.
  46. Object modeling by distribution function and a method of image generation. Journal of papers IEICE Japan’85 68, 4 (1985).
  47. Hierarchical cloth simulation using deep neural networks. In Proceedings of Computer Graphics International 2018. 139–146.
  48. Predicting loose-fitting garment deformations using bone-driven motion networks. In ACM SIGGRAPH 2022 Conference Proceedings. 1–10.
  49. Deepsdf: Learning continuous signed distance functions for shape representation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 165–174.
  50. Tailornet: Predicting clothing in 3d as a function of human pose, shape and garment style. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7365–7375.
  51. Learning Mesh-Based Simulation with Graph Networks. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021.
  52. Dyna: A model of dynamic human shape in motion. ACM Transactions on Graphics (TOG) 34, 4 (2015), 1–14.
  53. Xavier Provot. 1997. Collision and self-collision handling in cloth model dedicated to design garments. In Computer Animation and Simulation’97: Proceedings of the Eurographics Workshop in Budapest, Hungary, September 2–3, 1997. Springer, 177–189.
  54. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics 378 (2019), 686–707.
  55. Meshsdf: Differentiable iso-surface extraction. Advances in Neural Information Processing Systems 33 (2020), 22468–22478.
  56. Nadine Abu Rumman and Marco Fratarcangeli. 2017. Skin Deformation Methods for Interactive Character Animation. In Computer Vision, Imaging and Computer Graphics Theory and Applications: 11th International Joint Conference, VISIGRAPP 2016, Rome, Italy, February 27–29, 2016, Revised Selected Papers 11. Springer, 153–174.
  57. Pifu: Pixel-aligned implicit function for high-resolution clothed human digitization. In Proceedings of the IEEE/CVF international conference on computer vision. 2304–2314.
  58. Learning to simulate complex physics with graph networks. In International conference on machine learning. PMLR, 8459–8468.
  59. Learning-based animation of clothing for virtual try-on. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 355–366.
  60. SNUG: Self-Supervised Neural Dynamic Garments. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2022).
  61. Self-supervised collision handling via generative 3d garment models for virtual try-on. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11763–11773.
  62. Robust high-resolution cloth using parallelism, history-based collisions, and accurate friction. IEEE transactions on visualization and computer graphics 15, 2 (2008), 339–350.
  63. Towards Multi-Layered 3D Garments Animation. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 14361–14370.
  64. Deep marching tetrahedra: a hybrid representation for high-resolution 3d shape synthesis. Advances in Neural Information Processing Systems 34 (2021), 6087–6101.
  65. Fast proximity computation among deformable models using discrete voronoi diagrams. In ACM SIGGRAPH 2006 Papers. 1144–1153.
  66. Realtime simulation of thin-shell deformable materials using CNN-based mesh embedding. IEEE Robotics and Automation Letters 5, 2 (2020), 2325–2332.
  67. A Repulsive Force Unit for Garment Collision Handling in Neural Networks. In European Conference on Computer Vision. Springer, 451–467.
  68. Fast and exact continuous collision detection with bernstein sign classification. ACM Transactions on Graphics (TOG) 33, 6 (2014), 1–8.
  69. I-Cloth: Incremental collision handling for GPU-based interactive cloth simulation. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1–10.
  70. Elastically deformable models. In Proceedings of the 14th annual conference on Computer graphics and interactive techniques. 205–214.
  71. Example-based wrinkle synthesis for clothing animation. In ACM SIGGRAPH 2010 papers. 1–8.
  72. Learning an intrinsic garment space for interactive authoring of garment animation. ACM Transactions on Graphics (TOG) 38, 6 (2019), 1–12.
  73. Yongji Wang and Ching-Yao Lai. 2024. Multi-stage neural networks: Function approximator of machine precision. J. Comput. Phys. (2024), 112865.
  74. Weakly-Supervised 3D Reconstruction of Clothed Humans via Normal Maps. arXiv preprint arXiv:2311.16042 (2023).
  75. Soft objects. In Advanced Computer Graphics: Proceedings of Computer Graphics Tokyo’86. Springer, 113–128.
  76. Sensitivity-optimized rigging for example-based real-time clothing synthesis. ACM Trans. Graph. 33, 4 (2014), 107–1.
  77. Dynamic neural garments. ACM Transactions on Graphics (TOG) 40, 6 (2021), 1–15.
  78. Learning Anchor Transformations for 3D Garment Animation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 491–500.
  79. A deep emulator for secondary motion of 3d characters. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 5932–5940.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

This paper has been mentioned in 1 tweet and received 0 likes.

Upgrade to Pro to view all of the tweets about this paper:

Start a free 7-day Pro trial