Spatial Content Alignment for Pose Transfer

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

6 Scopus Citations
View graph of relations

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publication2021 IEEE International Conference on Multimedia and Expo (ICME)
PublisherIEEE
Number of pages6
ISBN (electronic)9781665438643
ISBN (print)9781665411523
Publication statusPublished - Jul 2021

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
ISSN (Print)1945-7871
ISSN (electronic)1945-788X

Conference

Title2021 IEEE International Conference on Multimedia and Expo (ICME 2021)
LocationVirtual
PlaceChina
CityShenzhen
Period5 - 9 July 2021

Abstract

Due to unreliable geometric matching and content misalignment, most conventional pose transfer algorithms fail to generate fine-trained person images. In this paper, we propose a novel framework – Spatial Content Alignment GAN (SCA-GAN) which aims to enhance the content consistency of garment textures and the details of human characteristics. We first alleviate the spatial misalignment by transferring the edge content to the target pose in advance. Secondly, we introduce a new Content-Style DeBlk which can progressively synthesize photo-realistic person images based on the appearance features of the source image, the target pose heatmap and the prior transferred content in edge domain. We compare the proposed framework with several state-of-the-art methods to show its superiority in quantitative and qualitative analysis. Moreover, detailed ablation study results demonstrate the efficacy of our contributions. Codes are publicly available at github.com/rocketappslab/SCA-GAN.

Research Area(s)

  • Image translation, Pose transfer, Spatial content alignment

Citation Format(s)

Spatial Content Alignment for Pose Transfer. / Yu, Wing Yin; Po, Lai Man; Zhao, Yuzhi et al.
2021 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 2021. (Proceedings - IEEE International Conference on Multimedia and Expo).

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review