The role of apparel in shaping human appearance underscores the significance of garment digitalization in the realm of digital human creation. Recent strides in 3D content creation have been pivotal, yet the generation of garments from text guidance remains relatively unexplored. Enter DressCode, a groundbreaking text-driven 3D garment generation framework poised to democratize design accessibility and revolutionize fashion creation, virtual try-on experiences, and digital human representation.
At the heart of DressCode lies SewingGPT, a cutting-edge architecture leveraging cross-attention mechanisms and text-conditioned embeddings to generate sewing patterns guided by textual prompts. This innovative approach empowers users to interact with the system naturally, facilitating seamless integration into the design workflow. Moreover, DressCode boasts a pre-trained Stable Diffusion model tailored for high-quality, tile-based PBR texture generation, further enhancing the realism and fidelity of the generated garments.
The framework's versatility extends beyond pattern generation, offering features such as pattern completion and texture editing through intuitive user interactions. By lowering the barriers to design entry, DressCode stimulates innovation and creativity, allowing users to experiment freely and incorporate unique elements into their designs.
In contrast to conventional methods, DressCode embraces a garment-centric approach, recognizing the structured nature of garments and the importance of sewing patterns in digital representation. Through meticulous design and training processes, DressCode achieves unprecedented levels of quality and alignment with input prompts, as validated through comprehensive evaluations and user studies.
DressCode's impact transcends mere convenience; it represents a paradigm shift in garment design, democratizing fashion creation and fostering inclusivity within the creative process. By harnessing the power of natural language interaction, DressCode empowers users, from novices to experts, to bring their design visions to life with unprecedented ease and fidelity.
Looking ahead, DressCode holds promise for reshaping the digital garment landscape, offering exciting possibilities for CG production, virtual try-on experiences, and digital human representation. As we embrace this era of text-driven innovation, DressCode stands at the forefront, poised to redefine the way we conceive, create, and interact with digital garments.
Download paper: https://arxiv.org/abs/2401.16465
