A highly efficient compression framework for time-varying 3-D facial expressions

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

22 Scopus Citations
View graph of relations

Author(s)

  • Junhui Hou
  • Lap-Pui Chau
  • Minqi Zhang
  • Nadia Magnenat-Thalmann
  • Ying He

Detail(s)

Original languageEnglish
Article number6778752
Pages (from-to)1541-1553
Journal / PublicationIEEE Transactions on Circuits and Systems for Video Technology
Volume24
Issue number9
Publication statusPublished - 1 Sep 2014
Externally publishedYes

Abstract

The rapid recent development of 3-DTV technology has led to an increase in studies on mesh-based 3-D scene representation. Compressing 3-D time-varying meshes is critical for the storage and transmission of 3-D contents. This paper proposes a highly efficient framework for compressing time-varying 3-D facial expressions. We use the near-isometric property of human facial expressions to parameterize the 3-D dynamic faces into an expression-invariant 2-D canonical domain that will naturally generate 2-D geometry videos (GVs). Considering the intrinsic properties of GVs, we apply low-rank and sparse matrix decomposition (LRSMD) separately to three dimensions of GVs (namely, X, Y, and Z). Based on our high precision rate and distortion models for GVs, we further compress the components from LRSMD using a video encoder in which bitrates of all components are assigned optimally according to the target bitrate. Experimental results show that the proposed scheme can significantly improve compression performance in terms of rate-distortion performance and visual quality compared with the state-of-the-art algorithms.

Research Area(s)

  • Geometry video (GV), low-rank and sparse matrix decomposition (LRSMD), optimal bit allocation, rate and distortion models, time-varying 3-D mesh

Citation Format(s)

A highly efficient compression framework for time-varying 3-D facial expressions. / Hou, Junhui; Chau, Lap-Pui; Zhang, Minqi; Magnenat-Thalmann, Nadia; He, Ying.

In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 24, No. 9, 6778752, 01.09.2014, p. 1541-1553.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review