Contrastive Graph Distribution Alignment for Partially View-Aligned Clustering

Xibiao Wang, Hang Gao, Xindian Wei, Liang Peng, Rui Li, Cheng Liu*, Si Wu, Hau-San Wong

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

1 Citation (Scopus)

Abstract

Partially View-aligned Clustering (PVC) presents a challenge as it requires a comprehensive exploration of complementary and consistent information in the presence of partial alignment of view data. Existing PVC methods typically learn view correspondence based on latent features that are expected to contain common semantic information. However, latent features obtained from heterogeneous spaces, along with the enforcement of alignment into the same feature dimension, can introduce cross-view discrepancies. In particular, partially view-aligned data lacks sufficient shared correspondences for the critical common semantic feature learning, resulting in inaccuracies in establishing meaningful correspondences between latent features across different views. While feature representations may differ across views, instance relationships within each view could potentially encode consistent common semantics across views. Motivated by this, our aim is to learn view correspondence based on graph distribution metrics that capture semantic view-invariant instance relationships. To achieve this, we utilize similarity graphs to depict instance relationships and learn view correspondence by aligning semantic similarity graphs through optimal transport with graph distribution. This facilitates the precise learning of view alignments, even in the presence of heterogeneous view-specific feature distortions. Furthermore, leveraging well-established cross-view correspondence, we introduce a cross-view contrastive learning to learn semantic features by exploiting consistency information. The resulting meaningful semantic features effectively isolate shared latent patterns, avoiding the inclusion of irrelevant private information. We conduct extensive experiments on several real datasets, demonstrating the effectiveness of our proposed method for the PVC task. © 2024 ACM.
Original languageEnglish
Title of host publicationMM '24 - Proceedings of the 32nd ACM International Conference on Multimedia
PublisherAssociation for Computing Machinery
Pages5240-5249
ISBN (Print)9798400706868
DOIs
Publication statusPublished - Oct 2024
Event32nd ACM International Conference on Multimedia (MM 2024) - Melbourne, Australia
Duration: 28 Oct 20241 Nov 2024
https://2024.acmmm.org/

Publication series

NameMM - Proceedings of the ACM International Conference on Multimedia

Conference

Conference32nd ACM International Conference on Multimedia (MM 2024)
Abbreviated titleACM MM’24
Country/TerritoryAustralia
CityMelbourne
Period28/10/241/11/24
Internet address

Bibliographical note

Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).

Funding

This work was supported in part by National Natural Science Foundation of China (Project No.62106136, No. 62072189), in part by the GuangDong Basic and Applied Basic Research Foundation (Project No. 2022A1515010434, 2022A1515011160, 2024A1515011437), in part by TCL Science and Technology Innovation Fund (Project No. 20231752), in part by the Research Grants Council of the Hong Kong Special Administration Region (Projection No. CityU 11206622) and in part by City University of Hong Kong (Project No. 7005986).

Research Keywords

  • multi-view clustering
  • partially view-aligned clustering

Fingerprint

Dive into the research topics of 'Contrastive Graph Distribution Alignment for Partially View-Aligned Clustering'. Together they form a unique fingerprint.

Cite this