Skip to main navigation Skip to search Skip to main content

From local to global: Hypergraph neural networks with holistic message passing

  • Yongchun Gu
  • , Yi Wang
  • , Xinxiang Wang
  • , Jiayi Mao
  • , Haodi Li
  • , Ming Li*
  • *Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

Most existing hypergraph neural networks (HNNs) follow a local message-passing paradigm, which inherently limits their receptive field and hampers their ability to capture long-range dependencies. This constraint is particularly severe in heterophilic scenarios, where we empirically observe that informative signals often reside in distant neighborhoods rather than immediate ones. To bridge this gap, we propose HyperHMP, a novel framework that shifts the focus from local aggregation to holistic message passing. By leveraging a structure-aware self-attention mechanism, HyperHMP enables direct, one-hop global information propagation across nodes and hyperedges. Specifically, we first integrate learnable positional encodings via an augmented incidence matrix to inject multi-level topological awareness. To facilitate efficient global fusion, we employ a virtual-node-assisted attention mechanism that simultaneously models node-node, node-hyperedge, and hyperedge-hyperedge interactions, effectively circumventing the information dilution typically caused by deep layer stacking. Furthermore, a hypergraph structural regularization scheme is introduced to ground the global attention within the intrinsic topology. Extensive experiments on both homophilic and heterophilic benchmarks demonstrate that HyperHMP consistently achieves state-of-the-art performance. For example, HyperHMP attains classification accuracies of 80.75% on Cora, 74.74% on Citeseer, 68.17% on Senate, and 75.17% on House, outperforming strong baselines such as HyperGT and ED-HNN by noticeable margins. These results confirm that capturing holistic structural relationships is essential for robust hypergraph representation learning. © 2026 Elsevier B.V.
Original languageEnglish
Article number115166
Number of pages12
JournalApplied Soft Computing
Volume197
Online published3 Apr 2026
DOIs
Publication statusOnline published - 3 Apr 2026

Funding

Ming Li acknowledges the support from National Natural Science Foundation of China (No. 62536006). Yongchun Gu acknowledges the support from the Zhejiang Provincial College Student Science and Technology Innovation Program (i.e. Xinmiao Talent Program of Zhejiang Province).

Research Keywords

  • Hypergraph learning
  • Hypergraph neural networks
  • Message passing
  • Self-attention

Fingerprint

Dive into the research topics of 'From local to global: Hypergraph neural networks with holistic message passing'. Together they form a unique fingerprint.

Cite this