Just Noticeable Distortion-Based Perceptual Rate Control in HEVC

Mingliang Zhou; Xuekai Wei; Sam Kwong; Weijia Jia; Bin Fang

doi:10.1109/TIP.2020.3004714

Just Noticeable Distortion-Based Perceptual Rate Control in HEVC

Mingliang Zhou^*, Xuekai Wei, Sam Kwong^*, Weijia Jia, Bin Fang

^*Corresponding author for this work

Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review

52 Citations (Scopus)

Abstract

In this paper, we propose a just noticeable distortion (JND)-ased perceptual rate control method for high efficiency video coding (HEVC). First, the JND factor of a coding unit has been mathematically shown to be an approximation of the average pixel-level JND weight, which means that it can also be used as a weight for bitrate allocation. Second, rate-distortion (R-D) modelling is conducted based on the JND factor. Finally, the proposed R-D model is integrated into an existing rate control framework to improve the coding efficiency, and the proposed algorithm is implemented in the newest video coding standard. As the experimental results reveal, compared with HEVC reference software, our algorithm achieves significantly improved coding performance, subjective coding quality and bitrate accuracy. © 2020 IEEE.

Original language	English
Article number	9130045
Pages (from-to)	7603-7614
Journal	IEEE Transactions on Image Processing
Volume	29
Online published	30 Jun 2020
DOIs	https://doi.org/10.1109/TIP.2020.3004714
Publication status	Published - 2020

Research Keywords

Human visual perception
JND
HEVC
perceptual rate control

Access Output

10.1109/TIP.2020.3004714

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

@article{c173620008854997b040f2f84faa1153,

title = "Just Noticeable Distortion-Based Perceptual Rate Control in HEVC",

abstract = "In this paper, we propose a just noticeable distortion (JND)-ased perceptual rate control method for high efficiency video coding (HEVC). First, the JND factor of a coding unit has been mathematically shown to be an approximation of the average pixel-level JND weight, which means that it can also be used as a weight for bitrate allocation. Second, rate-distortion (R-D) modelling is conducted based on the JND factor. Finally, the proposed R-D model is integrated into an existing rate control framework to improve the coding efficiency, and the proposed algorithm is implemented in the newest video coding standard. As the experimental results reveal, compared with HEVC reference software, our algorithm achieves significantly improved coding performance, subjective coding quality and bitrate accuracy. {\textcopyright} 2020 IEEE.",

keywords = "Human visual perception, JND, HEVC, perceptual rate control",

author = "Mingliang Zhou and Xuekai Wei and Sam Kwong and Weijia Jia and Bin Fang",

year = "2020",

doi = "10.1109/TIP.2020.3004714",

language = "English",

volume = "29",

pages = "7603--7614",

journal = "IEEE Transactions on Image Processing",

issn = "1057-7149",

publisher = "IEEE",

}

TY - JOUR

T1 - Just Noticeable Distortion-Based Perceptual Rate Control in HEVC

AU - Zhou, Mingliang

AU - Wei, Xuekai

AU - Kwong, Sam

AU - Jia, Weijia

AU - Fang, Bin

PY - 2020

Y1 - 2020

N2 - In this paper, we propose a just noticeable distortion (JND)-ased perceptual rate control method for high efficiency video coding (HEVC). First, the JND factor of a coding unit has been mathematically shown to be an approximation of the average pixel-level JND weight, which means that it can also be used as a weight for bitrate allocation. Second, rate-distortion (R-D) modelling is conducted based on the JND factor. Finally, the proposed R-D model is integrated into an existing rate control framework to improve the coding efficiency, and the proposed algorithm is implemented in the newest video coding standard. As the experimental results reveal, compared with HEVC reference software, our algorithm achieves significantly improved coding performance, subjective coding quality and bitrate accuracy. © 2020 IEEE.

AB - In this paper, we propose a just noticeable distortion (JND)-ased perceptual rate control method for high efficiency video coding (HEVC). First, the JND factor of a coding unit has been mathematically shown to be an approximation of the average pixel-level JND weight, which means that it can also be used as a weight for bitrate allocation. Second, rate-distortion (R-D) modelling is conducted based on the JND factor. Finally, the proposed R-D model is integrated into an existing rate control framework to improve the coding efficiency, and the proposed algorithm is implemented in the newest video coding standard. As the experimental results reveal, compared with HEVC reference software, our algorithm achieves significantly improved coding performance, subjective coding quality and bitrate accuracy. © 2020 IEEE.

KW - Human visual perception

KW - JND

KW - HEVC

KW - perceptual rate control

UR - http://www.scopus.com/inward/record.url?scp=85088317332&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85088317332&origin=recordpage

U2 - 10.1109/TIP.2020.3004714

DO - 10.1109/TIP.2020.3004714

M3 - RGC 21 - Publication in refereed journal

SN - 1057-7149

VL - 29

SP - 7603

EP - 7614

JO - IEEE Transactions on Image Processing

JF - IEEE Transactions on Image Processing

M1 - 9130045

ER -

Just Noticeable Distortion-Based Perceptual Rate Control in HEVC

Abstract

Research Keywords

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

GRF: Learning Based Hyperspectral Image Reconstruction and Discriminative Representation

ECS: Towards Immersive 3-D Telepresence: Compact Light-field Representation and Beyond

GRF: Learning-based Complexity Control for High Efficiency Video Coding and Beyond

Cite this

Just Noticeable Distortion-Based Perceptual Rate Control in HEVC

Abstract

Research Keywords

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Projects

GRF: Learning Based Hyperspectral Image Reconstruction and Discriminative Representation

ECS: Towards Immersive 3-D Telepresence: Compact Light-field Representation and Beyond

GRF: Learning-based Complexity Control for High Efficiency Video Coding and Beyond

Cite this