Towards Intelligent Design: A Self-Driven Framework for Collocated Clothing Synthesis Leveraging Fashion Styles and Textures

Minglong Dong (Co-first Author), Dongliang Zhou (Co-first Author), Jianghong Ma, Haijun Zhang*

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

Collocated clothing synthesis (CCS) has emerged as a pivotal topic in fashion technology, primarily concerned with the generation of a clothing item that harmoniously matches a given item. However, previous investigations have relied on using paired outfits, such as a pair of matching upper and lower clothing, to train a generative model for achieving this task. This reliance on the expertise of fashion professionals in the construction of such paired outfits has engendered a laborious and time-intensive process. In this paper, we introduce a new self-driven framework, named style- and texture-guided generative network (ST-Net), to synthesize collocated clothing without the necessity for paired outfits, leveraging self-supervised learning. ST-Net is designed to extrapolate fashion compatibility rules from the style and texture attributes of clothing, using a generative adversarial network. To facilitate the training and evaluation of our model, we have constructed a large-scale dataset specifically tailored for unsupervised CCS. Extensive experiments substantiate that our proposed method outperforms the state-of-the-art baselines in terms of both visual authenticity and fashion compatibility. © 2024 IEEE.
Original languageEnglish
Title of host publication2024 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024 - Proceedings
PublisherIEEE
Pages3725-3729
ISBN (Electronic)9798350344851
ISBN (Print)979-8-3503-4486-8
DOIs
Publication statusPublished - 2024
Event49th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2024) - COEX, Seoul, Korea, Republic of
Duration: 14 Apr 202419 Apr 2024
https://2024.ieeeicassp.org/

Publication series

NameICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
ISSN (Print)1520-6149
ISSN (Electronic)2379-190X

Conference

Conference49th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2024)
PlaceKorea, Republic of
CitySeoul
Period14/04/2419/04/24
Internet address

Funding

The order of authorship was determined by a coin toss. This work was supported in part by the National Natural Science Foundation of China under Grant 62202122, and 62073272, the Guangdong Basic and Applied Basic Research Foundation under Grant 2021B1515020088, the Shenzhen Science and Technology Program under Grant JCYJ20210324131203009, and the Harbin Institute of Technology (Shenzhen) (HITSZ)-J&A Joint Laboratory of Digital Design and Intelligent Fabrication under Grant HITSZ-J&A- 021A01.

Research Keywords

  • collocated clothing synthesis
  • fashion compatibility learning
  • outfit generation
  • unsupervised image-to-image translation

Fingerprint

Dive into the research topics of 'Towards Intelligent Design: A Self-Driven Framework for Collocated Clothing Synthesis Leveraging Fashion Styles and Textures'. Together they form a unique fingerprint.

Cite this