CTU-LEVEL RATE CONTROL WITH λ OPTIMIZATION BASED ON VISUAL GAZE MECHANISM FOR 360-DEGREE VERSATILE VIDEO CODING

Zeming Zhao; Meng Wang; Xiangjie Sui; Xiaohai He; Shiqi Wang

doi:10.1109/ICIP55913.2025.11084566

CTU-LEVEL RATE CONTROL WITH λ OPTIMIZATION BASED ON VISUAL GAZE MECHANISM FOR 360-DEGREE VERSATILE VIDEO CODING

Zeming Zhao
, Meng Wang
, Xiangjie Sui
, Xiaohai He
, Shiqi Wang^*

^*Corresponding author for this work

Department of Computer Science

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

Abstract

Understanding the human visual gaze mechanism is crucial for enhancing 360° video coding technology. This paper presents a Coding Tree Unit (CTU)-level rate control scheme with λ optimization strategy for 360° Versatile Video Coding (VVC), with the aim of enhancing rate-distortion performance and bitrate accuracy. Specifically, the Lagrange parameter λ is optimized with consideration of distortion dependency and the identification of key CTUs guided by visual gaze, which are derived from a 360° video path generation network, thoroughly integrating the characteristics of the human visual gaze. Experimental results show that the proposed scheme achieves BD-rate savings in terms of Weighted to Spherically uniform-Peak Signal-to-Noise Ratio (WS-PSNR) and Sphere-Peak Signal-to-Noise Ratio (S-PSNR) across various coding configurations. © 2025 IEEE.

Original language	English
Title of host publication	2025 IEEE International Conference on Image Processing (ICIP) - Proceedings
Publisher	IEEE
Pages	641-646
Number of pages	6
ISBN (Electronic)	9798331523794
ISBN (Print)	9798331523800
DOIs	https://doi.org/10.1109/ICIP55913.2025.11084566
Publication status	Published - 2025
Event	32nd IEEE International Conference on Image Processing (ICIP 2025): Imaging in the Age of GenAI - Anchorage, United States Duration: 14 Sept 2025 → 18 Sept 2025 https://2025.ieeeicip.org/

Publication series

Name	Proceedings - International Conference on Image Processing, ICIP
ISSN (Print)	1522-4880
ISSN (Electronic)	2381-8549

Conference

Conference	32nd IEEE International Conference on Image Processing (ICIP 2025)
Abbreviated title	IEEE ICIP 2025
Place	United States
City	Anchorage
Period	14/09/25 → 18/09/25
Internet address	https://2025.ieeeicip.org/

Funding

This work was supported in part by ITF Project GHP/044/21SZ; in part by RGC General Research Fund 11203220/11200323; in part by the National Natural Science Foundation of China (Grant No. 62271336 and Grant No. 62211530110) and in part by the Key Research and Development Program of Sichuan Province (Grant No. 2024YFHZ0289).

Research Keywords

360° video coding
distortion dependency
rate control
scanpath generator
λ optimization

RGC Funding Information

RGC-funded

Access Output

10.1109/ICIP55913.2025.11084566

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Zhao, Z., Wang, M., Sui, X., He, X., & Wang, S. (2025). CTU-LEVEL RATE CONTROL WITH λ OPTIMIZATION BASED ON VISUAL GAZE MECHANISM FOR 360-DEGREE VERSATILE VIDEO CODING. In 2025 IEEE International Conference on Image Processing (ICIP) - Proceedings (pp. 641-646). (Proceedings - International Conference on Image Processing, ICIP). IEEE. https://doi.org/10.1109/ICIP55913.2025.11084566

@inproceedings{d28b5761cefb4d1d99f56a57a247ac3d,

title = "CTU-LEVEL RATE CONTROL WITH λ OPTIMIZATION BASED ON VISUAL GAZE MECHANISM FOR 360-DEGREE VERSATILE VIDEO CODING",

abstract = "Understanding the human visual gaze mechanism is crucial for enhancing 360° video coding technology. This paper presents a Coding Tree Unit (CTU)-level rate control scheme with λ optimization strategy for 360° Versatile Video Coding (VVC), with the aim of enhancing rate-distortion performance and bitrate accuracy. Specifically, the Lagrange parameter λ is optimized with consideration of distortion dependency and the identification of key CTUs guided by visual gaze, which are derived from a 360° video path generation network, thoroughly integrating the characteristics of the human visual gaze. Experimental results show that the proposed scheme achieves BD-rate savings in terms of Weighted to Spherically uniform-Peak Signal-to-Noise Ratio (WS-PSNR) and Sphere-Peak Signal-to-Noise Ratio (S-PSNR) across various coding configurations. {\textcopyright} 2025 IEEE.",

keywords = "360° video coding, distortion dependency, rate control, scanpath generator, λ optimization",

author = "Zeming Zhao and Meng Wang and Xiangjie Sui and Xiaohai He and Shiqi Wang",

year = "2025",

doi = "10.1109/ICIP55913.2025.11084566",

language = "English",

isbn = "9798331523800",

series = "Proceedings - International Conference on Image Processing, ICIP",

publisher = "IEEE",

pages = "641--646",

booktitle = "2025 IEEE International Conference on Image Processing (ICIP) - Proceedings",

address = "United States",

note = "32nd IEEE International Conference on Image Processing (ICIP 2025) : Imaging in the Age of GenAI, IEEE ICIP 2025 ; Conference date: 14-09-2025 Through 18-09-2025",

url = "https://2025.ieeeicip.org/",

}

Zhao, Z, Wang, M, Sui, X, He, X & Wang, S 2025, CTU-LEVEL RATE CONTROL WITH λ OPTIMIZATION BASED ON VISUAL GAZE MECHANISM FOR 360-DEGREE VERSATILE VIDEO CODING. in 2025 IEEE International Conference on Image Processing (ICIP) - Proceedings. Proceedings - International Conference on Image Processing, ICIP, IEEE, pp. 641-646, 32nd IEEE International Conference on Image Processing (ICIP 2025), Anchorage, Alaska, United States, 14/09/25. https://doi.org/10.1109/ICIP55913.2025.11084566

CTU-LEVEL RATE CONTROL WITH λ OPTIMIZATION BASED ON VISUAL GAZE MECHANISM FOR 360-DEGREE VERSATILE VIDEO CODING. / Zhao, Zeming; Wang, Meng; Sui, Xiangjie et al.
2025 IEEE International Conference on Image Processing (ICIP) - Proceedings. IEEE, 2025. p. 641-646 (Proceedings - International Conference on Image Processing, ICIP).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - CTU-LEVEL RATE CONTROL WITH λ OPTIMIZATION BASED ON VISUAL GAZE MECHANISM FOR 360-DEGREE VERSATILE VIDEO CODING

AU - Zhao, Zeming

AU - Wang, Meng

AU - Sui, Xiangjie

AU - He, Xiaohai

AU - Wang, Shiqi

PY - 2025

Y1 - 2025

N2 - Understanding the human visual gaze mechanism is crucial for enhancing 360° video coding technology. This paper presents a Coding Tree Unit (CTU)-level rate control scheme with λ optimization strategy for 360° Versatile Video Coding (VVC), with the aim of enhancing rate-distortion performance and bitrate accuracy. Specifically, the Lagrange parameter λ is optimized with consideration of distortion dependency and the identification of key CTUs guided by visual gaze, which are derived from a 360° video path generation network, thoroughly integrating the characteristics of the human visual gaze. Experimental results show that the proposed scheme achieves BD-rate savings in terms of Weighted to Spherically uniform-Peak Signal-to-Noise Ratio (WS-PSNR) and Sphere-Peak Signal-to-Noise Ratio (S-PSNR) across various coding configurations. © 2025 IEEE.

AB - Understanding the human visual gaze mechanism is crucial for enhancing 360° video coding technology. This paper presents a Coding Tree Unit (CTU)-level rate control scheme with λ optimization strategy for 360° Versatile Video Coding (VVC), with the aim of enhancing rate-distortion performance and bitrate accuracy. Specifically, the Lagrange parameter λ is optimized with consideration of distortion dependency and the identification of key CTUs guided by visual gaze, which are derived from a 360° video path generation network, thoroughly integrating the characteristics of the human visual gaze. Experimental results show that the proposed scheme achieves BD-rate savings in terms of Weighted to Spherically uniform-Peak Signal-to-Noise Ratio (WS-PSNR) and Sphere-Peak Signal-to-Noise Ratio (S-PSNR) across various coding configurations. © 2025 IEEE.

KW - 360° video coding

KW - distortion dependency

KW - rate control

KW - scanpath generator

KW - λ optimization

UR - https://www.scopus.com/pages/publications/105028640644

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-105028640644&origin=recordpage

U2 - 10.1109/ICIP55913.2025.11084566

DO - 10.1109/ICIP55913.2025.11084566

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 9798331523800

T3 - Proceedings - International Conference on Image Processing, ICIP

SP - 641

EP - 646

BT - 2025 IEEE International Conference on Image Processing (ICIP) - Proceedings

PB - IEEE

T2 - 32nd IEEE International Conference on Image Processing (ICIP 2025)

Y2 - 14 September 2025 through 18 September 2025

ER -

Zhao Z, Wang M, Sui X, He X, Wang S. CTU-LEVEL RATE CONTROL WITH λ OPTIMIZATION BASED ON VISUAL GAZE MECHANISM FOR 360-DEGREE VERSATILE VIDEO CODING. In 2025 IEEE International Conference on Image Processing (ICIP) - Proceedings. IEEE. 2025. p. 641-646. (Proceedings - International Conference on Image Processing, ICIP). Epub 2025 Aug 18. doi: 10.1109/ICIP55913.2025.11084566

CTU-LEVEL RATE CONTROL WITH λ OPTIMIZATION BASED ON VISUAL GAZE MECHANISM FOR 360-DEGREE VERSATILE VIDEO CODING

Abstract

Publication series

Conference

Funding

Research Keywords

RGC Funding Information

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

GRF: Semantic Visual Data Compression for Vehicular Communications in Intelligent Driving Systems

ITF: Compression, Transmission and National Standardization for Ultra-high-definition VR Videos

GRF: Towards Smart Visual Sensor Data Representation with Intelligent Sensing in the Internet of Video Things

Cite this

CTU-LEVEL RATE CONTROL WITH λ OPTIMIZATION BASED ON VISUAL GAZE MECHANISM FOR 360-DEGREE VERSATILE VIDEO CODING

Abstract

Publication series

Conference

Funding

Research Keywords

RGC Funding Information

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Projects

GRF: Semantic Visual Data Compression for Vehicular Communications in Intelligent Driving Systems

ITF: Compression, Transmission and National Standardization for Ultra-high-definition VR Videos

GRF: Towards Smart Visual Sensor Data Representation with Intelligent Sensing in the Internet of Video Things

Cite this