Fast Robust Matrix Completion via Entry-Wise ℓ0-Norm Minimization

Xiao Peng Li, Zhang-Lei Shi*, Qi Liu, Hing Cheung So

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

23 Citations (Scopus)
202 Downloads (CityUHK Scholars)

Abstract

Matrix completion (MC) aims at recovering missing entries, given an incomplete matrix. Existing algorithms for MC are mainly designed for noiseless or Gaussian noise scenarios and, thus, they are not robust to impulsive noise. For outlier resistance, entry-wise p-norm with 0 < < 2 and M-estimation are two popular approaches. Yet the optimum selection of p for the entrywise p-norm-based methods is still an open problem. Besides, M-estimation is limited by a breakdown point, that is, the largest proportion of outliers. In this article, we adopt entrywise 0-norm, namely, the number of nonzero entries in a matrix, to separate anomalies from the observed matrix. Prior to separation, the Laplacian kernel is exploited for outlier detection, which provides a strategy to automatically update the entrywise ℓ0-norm penalty parameter. The resultant multivariable optimization problem is addressed by block coordinate descent (BCD), yielding 0-BCD and 0-BCD-F. The former detects and separates outliers, as well as its convergence is guaranteed. In contrast, the latter attempts to treat outlier-contaminated elements as missing entries, which leads to higher computational efficiency. Making use of majorization–minimization (MM), we further propose 0-BCD-MM and 0-BCD-MM-F for robust non-negative MC where the nonnegativity constraint is handled by a closed-form update. Experimental results of image inpainting and hyperspectral image recovery demonstrate that the suggested algorithms outperform several state-of-the-art methods in terms of recovery accuracy and computational efficiency.
Original languageEnglish
Pages (from-to)7199-7212
Number of pages14
JournalIEEE Transactions on Cybernetics
Volume53
Issue number11
Online published6 Dec 2022
DOIs
Publication statusPublished - Nov 2023

Funding

The work described in this paper was supported in part by a grant from the Research Grants Council of the Hong Kong Special Administrative Region, China [Project No. CityU 11207922], in part by the Fundamental Research Funds for the Central Universities under Grant 22CX06039A, and in part by the National Natural Science Foundation of China under Grant 62202174.

Research Keywords

  • ℓ0-norm optimization
  • matrix completion (MC)
  • non-negative MC (NMC)
  • outlier detection
  • robust recovery

Publisher's Copyright Statement

  • COPYRIGHT TERMS OF DEPOSITED POSTPRINT FILE: © 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Li, X. P., Shi, Z-L., Liu, Q., & So, H. C. (2022). Fast Robust Matrix Completion via Entry-Wise ℓ0-Norm Minimization. IEEE Transactions on Cybernetics. https://doi.org/10.1109/TCYB.2022.3224070.

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Fast Robust Matrix Completion via Entry-Wise ℓ0-Norm Minimization'. Together they form a unique fingerprint.

Cite this