TY - JOUR
T1 - Rate-distortion model based bit allocation for 3-D facial compression using geometry video
AU - Hou, Junhui
AU - Chau, Lap-Pui
AU - He, Ying
AU - Zhang, Minqi
AU - Magnenat-Thalmann, Nadia
PY - 2013
Y1 - 2013
N2 - With the extensive applications of 3-D multimedia technology, 3-D content compression has been an important issue, which ensures its smooth transmission on the network with constrained bandwidth. In this letter, we propose a new compression framework for dynamic 3-D facial expressions. Taking advantage of the near-isometric property of human facial expressions, we parameterize the dynamic 3-D faces into an expression-invariant canonical domain, which naturally generates 2-D geometry videos and allows us to apply the well-studied video compression techniques. Due to the difference from natural videos, each dimension (i.e., X, Y and Z, respectively) of the geometry video is regarded as a video sequence and encoded separately. Meanwhile, a model-based joint bit allocation scheme is designed to allocate reasonable bitrate to each dimension by detailed analysis of rate-distortion model for geometry videos, to obtain optimal results under given target bitrate. Experimental results show that up to 25% improvement in terms of bitrate reduction can be achieved, compared to existing algorithms. © 1991-2012 IEEE.
AB - With the extensive applications of 3-D multimedia technology, 3-D content compression has been an important issue, which ensures its smooth transmission on the network with constrained bandwidth. In this letter, we propose a new compression framework for dynamic 3-D facial expressions. Taking advantage of the near-isometric property of human facial expressions, we parameterize the dynamic 3-D faces into an expression-invariant canonical domain, which naturally generates 2-D geometry videos and allows us to apply the well-studied video compression techniques. Due to the difference from natural videos, each dimension (i.e., X, Y and Z, respectively) of the geometry video is regarded as a video sequence and encoded separately. Meanwhile, a model-based joint bit allocation scheme is designed to allocate reasonable bitrate to each dimension by detailed analysis of rate-distortion model for geometry videos, to obtain optimal results under given target bitrate. Experimental results show that up to 25% improvement in terms of bitrate reduction can be achieved, compared to existing algorithms. © 1991-2012 IEEE.
KW - Dynamic 3-D facial expressions
KW - geometry video
KW - H.264/AVC
KW - joint bit allocation
KW - mesh compression
KW - rate distortion model
UR - http://www.scopus.com/inward/record.url?scp=84883746977&partnerID=8YFLogxK
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-84883746977&origin=recordpage
U2 - 10.1109/TCSVT.2013.2248971
DO - 10.1109/TCSVT.2013.2248971
M3 - RGC 21 - Publication in refereed journal
SN - 1051-8215
VL - 23
SP - 1537
EP - 1541
JO - IEEE Transactions on Circuits and Systems for Video Technology
JF - IEEE Transactions on Circuits and Systems for Video Technology
IS - 9
M1 - 6470663
ER -