Decimated Framelet System on Graphs and Fast G-Framelet Transforms

Xuebin Zheng, Bingxin Zhou*, Yu Guang Wang*, Xiaosheng Zhuang

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

26 Citations (Scopus)
91 Downloads (CityUHK Scholars)

Abstract

Graph representation learning has many real-world applications, from self-driving LiDAR, 3D computer vision to drug repurposing, protein classification, social networks analysis. An adequate representation of graph data is vital to the learning performance of a statistical or machine learning model for graph-structured data. This paper proposes a novel multiscale representation system for graph data, called decimated framelets, which form a localized tight frame on the graph. The decimated framelet system allows storage of the graph data representation on a coarse-grained chain and processes the graph data at multi scales where at each scale, the data is stored on a subgraph. Based on this, we establish decimated G-framelet transforms for the decomposition and reconstruction of the graph data at multi resolutions via a constructive data-driven filter bank. The graph framelets are built on a chain-based orthonormal basis that supports fast graph Fourier transforms. From this, we give a fast algorithm for the decimated G-framelet transforms, or FGT, that has linear computational complexity O (N) for a graph of size N. The effectiveness for constructing the decimated framelet system and the FGT is demonstrated by a simulated example of random graphs and real-world applications, including multiresolution analysis for traffic network and representation learning of graph neural networks for graph classification tasks.
Original languageEnglish
Article number18
Number of pages68
JournalJournal of Machine Learning Research
Volume23
Online publishedFeb 2022
Publication statusPublished - 2022

Funding

The authors are grateful to Professors Junbin Gao, Ming Li and Pietro Li`o for their helpful comments. The last author acknowledges support in part from Research Grants Council of Hong Kong (Project No. CityU 11301419) and City University of Hong Kong (Project No. 7005497). The third author acknowledges the partial support of funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement no 757983), and the support of SJTU Explore X Fund (SD6040004/034) and SJTU Start-up Fund (WH220441902). This material is based upon work supported by the National Science Foundation under Grant No. DMS-1439786 while the third author was in residence at the Institute for Computational and Experimental Research in Mathematics in Providence, RI, during the Collaborate@ICERM on “Geometry of Data and Networks”.

Research Keywords

  • Graphs
  • Decimated tight framelets
  • Tree
  • SPOC
  • Undecimated tight framelets
  • Filter bank
  • Fast G-framelet transforms
  • Fast Fourier transforms
  • Coarse-grained chain
  • Graph Laplacian
  • Haar basis
  • Graph convolution
  • Graph neural networks
  • Multiresolution analysis
  • NONLINEAR DIMENSIONALITY REDUCTION
  • NEEDLET APPROXIMATION
  • TIGHT FRAMELETS
  • AFFINE SYSTEMS
  • WAVELET
  • REPRESENTATION
  • LAPLACIAN
  • CONVOLUTION
  • L-2(R-D)
  • SYMMETRY

Publisher's Copyright Statement

  • This full text is made available under CC-BY 4.0. https://creativecommons.org/licenses/by/4.0/

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Decimated Framelet System on Graphs and Fast G-Framelet Transforms'. Together they form a unique fingerprint.

Cite this