This work investigates hypergraph oversmoothing from a dynamical-systems perspective and develops a reaction--diffusion framework for depth-resistant hypergraph learning, which introduces a reaction mechanism acting on the transverse component to compensate diffusion-induced dissipation and stabilize discriminative variations.
Abstract
Higher-order couplings enhance the expressive power of hypergraph neural networks (HGNNs), but they also intensify representation collapse in deep propagation due to strong multi-way feature mixing. This work investigates hypergraph oversmoothing from a dynamical-systems perspective and develops a reaction--diffusion framework for depth-resistant hypergraph learning. By defining hypergraph gradient and divergence operators, we interpret message passing as an incidence-level diffusion process. The analysis of pure diffusion shows that its continuous semiflow exponentially contracts the null-mode-free component of node representations and drives the Dirichlet energy to zero, revealing hypergraph oversmoothing as an intrinsic transverse-energy dissipation phenomenon. Motivated by this analysis, we propose Hypergraph Neural Reaction--Diffusion (HNRD), which introduces a reaction mechanism acting on the transverse component to compensate diffusion-induced dissipation and stabilize discriminative variations. We establish global well-posedness of the proposed dynamics and prove that the null-mode-free Dirichlet energy remains bounded away from zero. A forward-Euler discretization provides a practical HNRD layer with a stability condition for deep propagation. Experiments on benchmark and synthetic heterophilic hypergraphs demonstrate that HNRD consistently improves over representative hypergraph baselines. Depth, robustness, and efficiency analyses further show that HNRD preserves stable performance and nonzero Dirichlet energy under deep propagation and perturbations. These results provide a principled dynamical framework for designing deep hypergraph architectures that maintain higher-order expressiveness without representation collapse.
This work presents a unified dynamical-systems perspective for shaping approaches that explicitly control and regulate the degree of propagation, conservation, and dissipation of information throughout the neural flow, and highlights how neural differential equations provide a coherent theoretical framework for designi...
This paper investigates the connection between self-supervised spectral representation learning and diffusion generative models through a shared perspective on perturbation kernels and finds that the optimization of the spectral alignment objective is in an equivalent form of diffusion score distillation in the represe...
Yuehao Wang, Pei-Hao Wang, Hanwen Jiang et al.· 0 citations
Analysis of a recurrent graph neural network in which independent Gaussian noise is injected after every propagation step reveals persistent stochastic perturbations as a fundamentally different mechanism for combating oversmoothing, complementing existing deterministic approaches based on residual connections, normali...
This work proposes Ricci-Diffusion, a curvature-guided graph diffusion method inspired by Ricci flow, which exhibits a Ricci-flow-like evolution, in which relative edge-level curvature modulates local transport in the diffusion kernel and guides edge-weight updates toward a more regular graph geometry.
The Stable Reaction-Diffusion encoder (SRD) provides a trajectory-stabilizing forward evolution mechanism that explicitly controls propagation drift and finite-depth sensitivity, rather than simply stacking additional message-passing layers.
Jia-Jun Lin, Yuxin Tian, Li Feng et al.· Neural Networks· 0 citations
This paper develops a hyperfinite formulation of score-based generative modeling within the framework of Nonstandard Analysis, and shows that minimization of an internal score-matching objective recovers the score function required by the reverse-time dynamics, thereby connecting score estimation with generative sampli...
Sunder Ram Krishnan· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.