Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

ClothCombo: Modeling Inter-Cloth Interaction for Draping Multi-Layered Clothes (2304.03492v2)

Published 7 Apr 2023 in cs.CV and cs.GR

Abstract: We present ClothCombo, a pipeline to drape arbitrary combinations of clothes on 3D human models with varying body shapes and poses. While existing learning-based approaches for draping clothes have shown promising results, multi-layered clothing remains challenging as it is non-trivial to model inter-cloth interaction. To this end, our method utilizes a GNN-based network to efficiently model the interaction between clothes in different layers, thus enabling multi-layered clothing. Specifically, we first create feature embedding for each cloth using a topology-agnostic network. Then, the draping network deforms all clothes to fit the target body shape and pose without considering inter-cloth interaction. Lastly, the untangling network predicts the per-vertex displacements in a way that resolves interpenetration between clothes. In experiments, the proposed model demonstrates strong performance in complex multi-layered scenarios. Being agnostic to cloth topology, our method can be readily used for layered virtual try-on of real clothes in diverse poses and combinations of clothes.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (92)
  1. SCAPE: Shape Completion and Animation of People. ACM Trans. Graph. 24, 3 (jul 2005), 408–416. https://doi.org/10.1145/1073204.1073207
  2. David Baraff and Andrew Witkin. 1998. Large steps in cloth simulation. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques. 43–54.
  3. CLOTH3D: clothed 3d humans. In European Conference on Computer Vision. Springer, 344–359.
  4. CLOTH3D: Clothed 3D Humans. In European Conference on Computer Vision. Springer, 344–359.
  5. PBNS: Physically Based Neural Simulator for Unsupervised Garment Pose Space Deformation. arXiv preprint arXiv:2012.11310 (2020).
  6. Neural Cloth Simulation. ACM Transactions on Graphics (TOG) 41, 6 (2022), 1–14.
  7. DeePSD: Automatic deep skinning and pose space deformation for 3D garment animation. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 5471–5480.
  8. Multi-garment net: Learning to dress 3d people from images. In proceedings of the IEEE/CVF international conference on computer vision. 5420–5430.
  9. Projective dynamics: Fusing constraint projections for fast simulation. ACM transactions on graphics (TOG) 33, 4 (2014), 1–11.
  10. Implicit Untangling: A Robust Solution for Modeling Layered Clothing. ACM Transactions on Graphics 38 (07 2019). https://doi.org/10.1145/3306346.3323010
  11. TightCap: 3D human shape capture with clothing tightness. arXiv preprint arXiv:1904.02601 (2019).
  12. Kwang-Jin Choi and Hyeong-Seok Ko. 2005. Research problems in clothing simulation. Computer-aided design 37, 6 (2005), 585–592.
  13. Yarn-level simulation of woven cloth. ACM Transactions on Graphics (TOG) 33, 6 (2014), 1–11.
  14. Smplicit: Topology-aware generative model for clothed people. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11875–11885.
  15. Discovering Symbolic Models from Deep Learning with Inductive Biases. arXiv preprint arXiv:2006.11287 (2020).
  16. Stable spaces for real-time clothing. ACM Transactions on Graphics (TOG) 29, 4 (2010), 1–9.
  17. DrapeNet: Generating Garments and Draping them with Self-Supervision. arXiv preprint arXiv:2211.11277 (2022).
  18. Element-wise mixed implicit-explicit integration for stable dynamic simulation of deformable objects. In Proceedings of the 2011 ACM SIGGRAPH/eurographics symposium on computer animation. 257–266.
  19. Real-time dynamic wrinkling of coarse animated cloth. In Proceedings of the 14th ACM SIGGRAPH/eurographics symposium on computer animation. 17–26.
  20. HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics. arXiv preprint arXiv:2212.07242 (2022).
  21. Drape: Dressing any person. ACM Transactions on Graphics (ToG) 31, 4 (2012), 1–10.
  22. Garnet++: Improving fast and accurate static 3d cloth draping by curvature loss. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 1 (2020), 181–195.
  23. Garnet: A two-stream network for fast and accurate 3d cloth draping. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 8739–8748.
  24. Subspace clothing simulation using adaptive bases. ACM Transactions on Graphics (TOG) 33, 4 (2014), 1–9.
  25. PhysGraph: Physics-Based Integration Using Graph Neural Networks. arXiv preprint arXiv:2301.11841 (2023).
  26. MeshCNN: A Network with an Edge. ACM Transactions on Graphics (TOG) 38, 4 (2019), 90:1–90:12.
  27. Asynchronous contact mechanics. In ACM SIGGRAPH 2009 papers. 1–12.
  28. Analysis of numerical methods for the simulation of deformable models. The Visual Computer 19, 7 (2003), 581–600.
  29. Dan Hendrycks and Kevin Gimpel. 2016. Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415 (2016).
  30. Physics-as-Inverse-Graphics: Unsupervised Physical Parameter Estimation from Video. In Int. Conf. Learning Representations.
  31. Bcnet: Learning body and cloth shape from a single image. In European Conference on Computer Vision. Springer, 18–35.
  32. Anisotropic elastoplasticity for cloth, knit and hair frictional contact. ACM Transactions on Graphics (TOG) 36, 4 (2017), 1–14.
  33. Simulating knitted cloth at the yarn level. In ACM SIGGRAPH 2008 papers. 1–9.
  34. Near-exhaustive precomputation of secondary cloth effects. ACM Transactions on Graphics (TOG) 32, 4 (2013), 1–8.
  35. Maria Korosteleva and Sung-Hee Lee. 2021. Generating Datasets of 3D Garments with Sewing Patterns. arXiv preprint arXiv:2109.05633 (2021).
  36. Maria Korosteleva and Sung-Hee Lee. 2022. NeuralTailor: Reconstructing Sewing Pattern Structures from 3D Point Clouds of Garments. arXiv preprint arXiv:2201.13063 (2022).
  37. Alon Lahav and Ayellet Tal. 2020. Meshwalker: Deep mesh understanding by random walks. ACM Transactions on Graphics (TOG) 39, 6 (2020), 1–13.
  38. Deepwrinkles: Accurate and realistic clothing modeling. In Proceedings of the European conference on computer vision (ECCV). 667–684.
  39. DIG: Draping Implicit Garment over the Human Body. In Proceedings of the Asian Conference on Computer Vision. 2780–2795.
  40. Learning a model of facial shape and expression from 4D scans. ACM Transactions on Graphics, (Proc. SIGGRAPH Asia) 36, 6 (2017). https://doi.org/10.1145/3130800.3130813
  41. Pointcnn: Convolution on x-transformed points. Advances in neural information processing systems 31 (2018).
  42. Fast simulation of mass-spring systems. ACM Transactions on Graphics (TOG) 32, 6 (2013), 1–7.
  43. SMPL: A Skinned Multi-Person Linear Model. ACM Trans. Graphics (Proc. SIGGRAPH Asia) 34, 6 (Oct. 2015), 248:1–248:16.
  44. Anisotropic strain limiting for quadrilateral and triangular cloth meshes. In Computer graphics forum, Vol. 35. Wiley Online Library, 89–99.
  45. Learning to dress 3d people in generative clothing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6469–6478.
  46. Learning Cloth Dynamics: 3D + Texture Garment Reconstruction Benchmark. In Proceedings of the NeurIPS 2020 Competition and Demonstration Track, PMLR, Vol. 133. 57–76.
  47. Learning cloth dynamics: 3d+ texture garment reconstruction benchmark. In NeurIPS 2020 Competition and Demonstration Track. PMLR, 57–76.
  48. AMASS: Archive of Motion Capture as Surface Shapes. In International Conference on Computer Vision. 5442–5451.
  49. Modulated Periodic Activations for Generalizable Local Functional Representations. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). 14214–14223.
  50. Field Convolutions for Surface CNNs. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). 10001–10011.
  51. Matthias Müller. 2008. Hierarchical position based dynamics. (2008).
  52. Matthias Müller and Nuttapong Chentanez. 2010. Wrinkle Meshes.. In Symposium on Computer Animation. Madrid, Spain, 85–91.
  53. Position based dynamics. Journal of Visual Communication and Image Representation 18, 2 (2007), 109–118.
  54. Adaptive anisotropic remeshing for cloth simulation. ACM transactions on graphics (TOG) 31, 6 (2012), 1–10.
  55. Physically based deformable models in computer graphics. In Computer graphics forum, Vol. 25. Wiley Online Library, 809–836.
  56. Young Jin Oh and In-Kwon Lee. 2021. Two-step Temporal Interpolation Network Using Forward Advection for Efficient Smoke Simulation. In Computer Graphics Forum, Vol. 40. Wiley Online Library, 355–365.
  57. Hierarchical cloth simulation using deep neural networks. In Proceedings of Computer Graphics International 2018. 139–146.
  58. Predicting loose-fitting garment deformations using bone-driven motion networks. In ACM SIGGRAPH 2022 Conference Proceedings. 1–10.
  59. Tailornet: Predicting clothing in 3d as a function of human pose, shape and garment style. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7365–7375.
  60. Expressive Body Capture: 3D Hands, Face, and Body from a Single Image. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 10975–10985.
  61. ClothCap: Seamless 4D clothing capture and retargeting. ACM Transactions on Graphics (ToG) 36, 4 (2017), 1–15.
  62. Pointnet: Deep learning on point sets for 3d classification and segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition. 652–660.
  63. Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Advances in neural information processing systems 30 (2017).
  64. Animation wrinkling: augmenting coarse cloth simulations with realistic-looking wrinkles. ACM Transactions on Graphics (TOG) 29, 6 (2010), 1–8.
  65. Embodied Hands: Modeling and Capturing Hands and Bodies Together. ACM Transactions on Graphics, (Proc. SIGGRAPH Asia) 36, 6 (Nov. 2017).
  66. SCANimate: Weakly supervised learning of skinned clothed avatar networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2886–2897.
  67. Learning to simulate complex physics with graph networks. In International Conference on Machine Learning. PMLR, 8459–8468.
  68. Learning-based animation of clothing for virtual try-on. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 355–366.
  69. SNUG: Self-Supervised Neural Dynamic Garments. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2022).
  70. ULNeF: Untangled Layered Neural Fields for Mix-and-Match Virtual Try-On. In Advances in Neural Information Processing Systems, (NeurIPS).
  71. Self-supervised collision handling via generative 3d garment models for virtual try-on. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11763–11773.
  72. Robust high-resolution cloth using parallelism, history-based collisions, and accurate friction. IEEE transactions on visualization and computer graphics 15, 2 (2008), 339–350.
  73. Diffusionnet: Discretization agnostic learning on surfaces. ACM Transactions on Graphics (TOG) 41, 3 (2022), 1–16.
  74. Dmitriy Smirnov and Justin Solomon. 2021. HodgeNet: Learning Spectral Geometry on Triangle Meshes. SIGGRAPH (2021).
  75. Estimation of yarn-level simulation models for production fabrics. ACM Transactions on Graphics (TOG) 41, 4 (2022), 1–15.
  76. I-Cloth: Incremental collision handling for GPU-based interactive cloth simulation. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1–10.
  77. Elastically deformable models. In Proceedings of the 14th annual conference on Computer graphics and interactive techniques. 205–214.
  78. KPConv: Flexible and Deformable Convolution for Point Clouds. Proceedings of the IEEE International Conference on Computer Vision (2019).
  79. Continuum-based strain limiting. In Computer Graphics Forum, Vol. 28. Wiley Online Library, 569–576.
  80. Sizer: A dataset and model for parsing 3d clothing and learning size sensitive 3d clothing. In European Conference on Computer Vision. Springer, 1–18.
  81. Neural-GIF: Neural generalized implicit functions for animating people in clothing. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 11708–11718.
  82. Example-based wrinkle synthesis for clothing animation. In ACM SIGGRAPH 2010 papers. 1–8.
  83. Multi-resolution isotropic strain limiting. ACM Transactions on Graphics (TOG) 29, 6 (2010), 1–10.
  84. Huamin Wang and Yin Yang. 2016. Descent methods for elastic body simulation on the GPU. ACM Transactions on Graphics (TOG) 35, 6 (2016), 1–10.
  85. Learning a shared shape space for multimodal garment design. arXiv preprint arXiv:1806.11335 (2018).
  86. Learning an intrinsic garment space for interactive authoring of garment animation. ACM Transactions on Graphics (TOG) 38, 6 (2019), 1–12.
  87. Dynamic Graph CNN for Learning on Point Clouds. ACM Transactions on Graphics (TOG) (2019).
  88. AgentDress: Realtime Clothing Synthesis for Virtual Agents using Plausible Deformations. IEEE Transactions on Visualization and Computer Graphics 27, 11 (2021), 4107–4118.
  89. Sensitivity-optimized rigging for example-based real-time clothing synthesis. ACM Trans. Graph. 33, 4 (2014), 107–1.
  90. 3d virtual garment modeling from rgb images. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 37–45.
  91. Motion guided deep dynamic 3d garments. ACM Transactions on Graphics (TOG) 41, 6 (2022), 1–12.
  92. Deep detail enhancement for any garment. In Computer Graphics Forum, Vol. 40. Wiley Online Library, 399–411.
Citations (5)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now