Spatial Content Alignment for Pose Transfer

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

9 Citations (Scopus)

Abstract

Due to unreliable geometric matching and content misalignment, most conventional pose transfer algorithms fail to generate fine-trained person images. In this paper, we propose a novel framework – Spatial Content Alignment GAN (SCA-GAN) which aims to enhance the content consistency of garment textures and the details of human characteristics. We first alleviate the spatial misalignment by transferring the edge content to the target pose in advance. Secondly, we introduce a new Content-Style DeBlk which can progressively synthesize photo-realistic person images based on the appearance features of the source image, the target pose heatmap and the prior transferred content in edge domain. We compare the proposed framework with several state-of-the-art methods to show its superiority in quantitative and qualitative analysis. Moreover, detailed ablation study results demonstrate the efficacy of our contributions. Codes are publicly available at github.com/rocketappslab/SCA-GAN.
Original languageEnglish
Title of host publication2021 IEEE International Conference on Multimedia and Expo (ICME)
PublisherIEEE
Number of pages6
ISBN (Electronic)9781665438643
ISBN (Print)9781665411523
DOIs
Publication statusPublished - Jul 2021
Event2021 IEEE International Conference on Multimedia and Expo (ICME 2021) - Virtual, Shenzhen, China
Duration: 5 Jul 20219 Jul 2021
https://2021.ieeeicme.org/

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Conference

Conference2021 IEEE International Conference on Multimedia and Expo (ICME 2021)
Abbreviated titleICME2021
PlaceChina
CityShenzhen
Period5/07/219/07/21
Internet address

Research Keywords

  • Image translation
  • Pose transfer
  • Spatial content alignment

Fingerprint

Dive into the research topics of 'Spatial Content Alignment for Pose Transfer'. Together they form a unique fingerprint.

Cite this