Semantic Face Compression for Metaverse : A Compact 3D Descriptor Based Approach
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Pages (from-to) | 8978-8982 |
Number of pages | 5 |
Journal / Publication | IEEE Transactions on Circuits and Systems for Video Technology |
Volume | 34 |
Issue number | 9 |
Online published | 19 Apr 2024 |
Publication status | Published - Sept 2024 |
Link(s)
Abstract
The metaverse, a 3D virtual world, requires efficient interactive avatar communication. To achieve this goal, we envision a new metaverse paradigm for virtual avatar faces and develop semantic face compression with compact 3D facial descriptors. The paradigm comprises a compression framework that transmits 3D face descriptors for semantic compression and applications based on the semantic descriptors. The fundamental principle is that the communication of virtual avatar faces primarily emphasizes the conveyance of semantic information. In light of this, the proposed scheme offers the advantages of being highly flexible, efficient, and semantically meaningful. The promise of the proposed paradigm is also demonstrated by performance comparisons with the state-of-the-art video coding standard, Versatile Video Coding. A significant improvement in terms of rate-accuracy performance has been achieved. The proposed scheme is expected to enable numerous applications especially for real-time communication in the metaverse, such as digital human communication based on machine analysis, and to form the cornerstone of interactions. © 2024 IEEE.
Research Area(s)
- 3D descriptor, emotion recognition, face identification, intelligent machine task, Metaverse, real-time communication, semantic face compression
Bibliographic Note
Research Unit(s) information for this publication is provided by the author(s) concerned.
Citation Format(s)
Semantic Face Compression for Metaverse: A Compact 3D Descriptor Based Approach. / Li, Binzhe; Chen, Bolin; Wang, Zhao et al.
In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 34, No. 9, 09.2024, p. 8978-8982.
In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 34, No. 9, 09.2024, p. 8978-8982.
Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review