Rate-distortion model based bit allocation for 3-D facial compression using geometry video

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

8 Scopus Citations
View graph of relations

Author(s)

  • Junhui Hou
  • Lap-Pui Chau
  • Ying He
  • Minqi Zhang
  • Nadia Magnenat-Thalmann

Detail(s)

Original languageEnglish
Article number6470663
Pages (from-to)1537-1541
Journal / PublicationIEEE Transactions on Circuits and Systems for Video Technology
Volume23
Issue number9
Publication statusPublished - 2013
Externally publishedYes

Abstract

With the extensive applications of 3-D multimedia technology, 3-D content compression has been an important issue, which ensures its smooth transmission on the network with constrained bandwidth. In this letter, we propose a new compression framework for dynamic 3-D facial expressions. Taking advantage of the near-isometric property of human facial expressions, we parameterize the dynamic 3-D faces into an expression-invariant canonical domain, which naturally generates 2-D geometry videos and allows us to apply the well-studied video compression techniques. Due to the difference from natural videos, each dimension (i.e., X, Y and Z, respectively) of the geometry video is regarded as a video sequence and encoded separately. Meanwhile, a model-based joint bit allocation scheme is designed to allocate reasonable bitrate to each dimension by detailed analysis of rate-distortion model for geometry videos, to obtain optimal results under given target bitrate. Experimental results show that up to 25% improvement in terms of bitrate reduction can be achieved, compared to existing algorithms. © 1991-2012 IEEE.

Research Area(s)

  • Dynamic 3-D facial expressions, geometry video, H.264/AVC, joint bit allocation, mesh compression, rate distortion model

Citation Format(s)

Rate-distortion model based bit allocation for 3-D facial compression using geometry video. / Hou, Junhui; Chau, Lap-Pui; He, Ying; Zhang, Minqi; Magnenat-Thalmann, Nadia.

In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 23, No. 9, 6470663, 2013, p. 1537-1541.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review