Dress Anyone : Automatic Physically-Based Garment Pattern Refitting (2405.19148v1)
Abstract: Well-fitted clothing is essential for both real and virtual garments to enable self-expression and accurate representation for a large variety of body types. Common practice in the industry is to provide a pre-made selection of distinct garment sizes such as small, medium and large. While these may cater to certain groups of individuals that fall within this distribution, they often exclude large sections of the population. In contrast, individually tailored clothing offers a solution to obtain custom-fit garments that are tailored to each individual. However, manual tailoring is time-consuming and requires specialized knowledge, prohibiting the approach from being applied to produce fitted clothing at scale. To address this challenge, we propose a novel method leveraging differentiable simulation for refitting and draping 3D garments and their corresponding 2D pattern panels onto a new body shape, enabling a workflow where garments only need to be designed once, in a single size, and they can be automatically refitted to support numerous body size and shape variations. Our method enables downstream applications, where our optimized 3D drape can be directly ingested into game engines or other applications. Our 2D sewing patterns allow for accurate physics-based simulations and enables manufacturing clothing for the real world.
- Estimating garment patterns from static scan data. In Computer Graphics Forum, Vol. 40. Wiley Online Library, 273–287.
- David Baraff and Andrew Witkin. 1998. Large steps in cloth simulation. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’98). Association for Computing Machinery, New York, NY, USA, 43–54. https://doi.org/10.1145/280814.280821
- Physics-driven pattern adjustment for direct 3D garment editing. ACM Trans. Graph. 35, 4 (2016), 50–1.
- Projective Dynamics: Fusing Constraint Projections for Fast Simulation. Acm Transactions On Graphics 33, 4 (2014), 154.
- Design preserving garment transfer. ACM Transactions on Graphics 31, 4 (2012), Article–No.
- Vertex Block Descent. arXiv preprint arXiv:2403.06321 (2024).
- Panelformer: Sewing Pattern Reconstruction From 2D Garment Images. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 454–463.
- Virtual elastic objects. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 15827–15837.
- Structure-Preserving 3D Garment Modeling with Neural Sewing Machines. Advances in Neural Information Processing Systems 35 (2022), 15147–15159.
- Kwang-Jin Choi and Hyeong-Seok Ko. 2002. Stable but responsive cloth. ACM Transactions on Graphics (TOG) 21, 3 (2002), 604–611.
- Garment Refitting for Digital Characters. In ACM SIGGRAPH 2020 Talks (Virtual Event, USA) (SIGGRAPH ’20). Association for Computing Machinery, New York, NY, USA, Article 74, 2 pages. https://doi.org/10.1145/3388767.3407348
- Diffpd: Differentiable projective dynamics. ACM Transactions on Graphics (TOG) 41, 2 (2021), 1–21.
- A Fast Finite Element Solution for Cloth Modelling. In Proceedings of the 11th Pacific Conference on Computer Graphics and Applications (PG ’03). IEEE Computer Society, USA, 244.
- Optimization integrator for large time steps. IEEE transactions on visualization and computer graphics 21, 10 (2015), 1103–1115.
- A material point method for thin shells with frictional contact. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1–15.
- Pattern-based cloth registration and sparse-view animation. ACM Transactions on Graphics (TOG) 41, 6 (2022), 1–17.
- DressCode: Autoregressively Sewing and Generating Garments from Text Guidance. arXiv:2401.16465 [cs.CV]
- Maria Korosteleva and Sung-Hee Lee. 2022. Neuraltailor: Reconstructing sewing pattern structures from 3d point clouds of garments. ACM Transactions on Graphics (TOG) 41, 4 (2022), 1–16.
- Maria Korosteleva and Olga Sorkine-Hornung. 2023. GarmentCode: Programming Parametric Sewing Patterns. ACM Transactions on Graphics (TOG) 42, 6 (2023), 1–15.
- Estimating cloth elasticity parameters using position-based simulation of compliant constrained dynamics. arXiv preprint arXiv:2212.08790 (2022).
- Garment Recovery with Shape and Deformation Priors. arXiv preprint arXiv:2311.10356 (2023).
- Isp: Multi-layered garment draping with implicit sewing patterns. Advances in Neural Information Processing Systems 36 (2024).
- DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulation. IEEE Conference on Computer Vision and Pattern Recognition(CVPR) (2024).
- Diffcloth: Differentiable cloth simulation with dry frictional contact. ACM Transactions on Graphics (TOG) 42, 1 (2022), 1–20.
- Differentiable cloth simulation for inverse problems. Advances in Neural Information Processing Systems 32 (2019).
- Green coordinates. ACM transactions on graphics (TOG) 27, 3 (2008), 1–10.
- Towards garment sewing pattern reconstruction from a single image. ACM Transactions on Graphics (TOG) 42, 6 (2023), 1–15.
- SMPL: A Skinned Multi-Person Linear Model. ACM Trans. Graphics (Proc. SIGGRAPH Asia) 34, 6 (Oct. 2015), 248:1–248:16.
- XPBD: position-based simulation of compliant constrained dynamics. In Proceedings of the 9th International Conference on Motion in Games. 49–54.
- Example-based elastic materials. In ACM SIGGRAPH 2011 papers. 1–8.
- Position based dynamics. Journal of Visual Communication and Image Representation 18, 2 (2007), 109–118.
- Computational pattern making from 3D garment models. ACM Trans. Graph. 41, 4 (2022), 157–1.
- Garment3DGen: 3D Garment Stylization and Texture Generation. arXiv preprint arXiv:2403.18816 (2024).
- Jonathan Richard Shewchuk. 2002. What is a Good Linear Element? Interpolation, Conditioning, and Quality Measures. In International Meshing Roundtable Conference. https://api.semanticscholar.org/CorpusID:8691914
- Tuur Stuyck. 2022. Cloth simulation for computer graphics. Springer Nature.
- Tuur Stuyck and Hsiao-yu Chen. 2023. Diffxpbd: Differentiable position-based simulation of compliant constraint dynamics. Proceedings of the ACM on Computer Graphics and Interactive Techniques 6, 3 (2023), 1–14.
- Elastically deformable models. SIGGRAPH Comput. Graph. 21, 4 (aug 1987), 205–214. https://doi.org/10.1145/37402.37427
- Huamin Wang. 2018. Rule-free sewing pattern adjustment with precision and efficiency. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1–13.
- Keyframe control of complex particle systems using the adjoint method. In Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation. 15–23.
- Designing Personalized Garments with Body Movement. In Computer Graphics Forum, Vol. 42. Wiley Online Library, 180–194.
- Dressing avatars: Deep photorealistic appearance for physically simulated clothing. ACM Transactions on Graphics (TOG) 41, 6 (2022), 1–15.
- Physics-Inspired Garment Recovery from a Single-View Image. ACM Trans. Graph. 37, 5, Article 170 (nov 2018), 14 pages. https://doi.org/10.1145/3026479
- PhysAvatar: Learning the Physics of Dressed 3D Avatars from Visual Observations. arxiv.