PQA-Net : Deep No Reference Point Cloud Quality Assessment via Multi-view Projection

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

2 Scopus Citations
View graph of relations

Author(s)

  • Qi Liu
  • Hui Yuan
  • Honglei Su
  • Hao Liu
  • Yu Wang
  • Huan Yang

Related Research Unit(s)

Detail(s)

Original languageEnglish
Pages (from-to)4645-4660
Number of pages17
Journal / PublicationIEEE Transactions on Circuits and Systems for Video Technology
Volume31
Issue number12
Online published26 Jul 2021
Publication statusPublished - Dec 2021

Abstract

Recently, 3D point cloud is becoming popular due to its capability to represent the real world for advanced content modality in modern communication systems. In view of its wide applications, especially for immersive communication towards human perception, quality metrics for point clouds are essential. Existing point cloud quality evaluations rely on a full or certain portion of the original point cloud, which severely limits their applications. To overcome this problem, we propose a novel deep learning-based no reference point cloud quality assessment method, namely PQA-Net. Specifically, the PQA-Net consists of a multi-view-based joint feature extraction and fusion (MVFEF) module, a distortion type identification (DTI) module, and a quality vector prediction (QVP) module. The DTI and QVP modules share the feature generated from the MVFEF module. By using the distortion type labels, the DTI and the MVFEF modules are first pre-trained to initialize the network parameters, based on which the whole network is then jointly trained to finally evaluate the point cloud quality. Experimental results on the Waterloo Point Cloud dataset show that PQA-Net achieves better or equivalent performance comparing with the state-of-the-art quality assessment methods. The code of the proposed model will be made publicly available to facilitate reproducible research https://github.com/qdushl/PQA-Net.

Research Area(s)

  • deep neural network, Distortion, Feature extraction, Geometry, Image color analysis, Measurement, multi-task learning, multi-view, no-reference point cloud quality assessment, Quality assessment, Three-dimensional displays

Citation Format(s)

PQA-Net : Deep No Reference Point Cloud Quality Assessment via Multi-view Projection. / Liu, Qi; Yuan, Hui; Su, Honglei; Liu, Hao; Wang, Yu; Yang, Huan; Hou, Junhui.

In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 31, No. 12, 12.2021, p. 4645-4660.

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review