Spatial Content Alignment for Pose Transfer
Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45) › 32_Refereed conference paper (with ISBN/ISSN) › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Title of host publication | 2021 IEEE International Conference on Multimedia and Expo (ICME) |
Publisher | IEEE |
Number of pages | 6 |
ISBN (Electronic) | 9781665438643 |
ISBN (Print) | 9781665411523 |
Publication status | Published - Jul 2021 |
Publication series
Name | Proceedings - IEEE International Conference on Multimedia and Expo |
---|---|
ISSN (Print) | 1945-7871 |
ISSN (Electronic) | 1945-788X |
Conference
Title | 2021 IEEE International Conference on Multimedia and Expo (ICME 2021) |
---|---|
Location | Virtual |
Place | China |
City | Shenzhen |
Period | 5 - 9 July 2021 |
Link(s)
Abstract
Due to unreliable geometric matching and content misalignment, most conventional pose transfer algorithms fail to generate fine-trained person images. In this paper, we propose a novel framework – Spatial Content Alignment GAN (SCA-GAN) which aims to enhance the content consistency of garment textures and the details of human characteristics. We first alleviate the spatial misalignment by transferring the edge content to the target pose in advance. Secondly, we introduce a new Content-Style DeBlk which can progressively synthesize photo-realistic person images based on the appearance features of the source image, the target pose heatmap and the prior transferred content in edge domain. We compare the proposed framework with several state-of-the-art methods to show its superiority in quantitative and qualitative analysis. Moreover, detailed ablation study results demonstrate the efficacy of our contributions. Codes are publicly available at github.com/rocketappslab/SCA-GAN.
Research Area(s)
- Image translation, Pose transfer, Spatial content alignment
Citation Format(s)
Spatial Content Alignment for Pose Transfer. / Yu, Wing Yin; Po, Lai Man; Zhao, Yuzhi et al.
2021 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 2021. (Proceedings - IEEE International Conference on Multimedia and Expo).Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45) › 32_Refereed conference paper (with ISBN/ISSN) › peer-review