Skip to content

From Diffusion to Reaction-Diffusion: A Dynamical-Systems View of Oversmoothing in Hypergraph Neural Networks

Jul 2026 · arXiv.org · Vol abs/2607.15773 · 0 citations · 48 references
Computer Science

TL;DR

This work investigates hypergraph oversmoothing from a dynamical-systems perspective and develops a reaction--diffusion framework for depth-resistant hypergraph learning, which introduces a reaction mechanism acting on the transverse component to compensate diffusion-induced dissipation and stabilize discriminative variations.

Abstract

Higher-order couplings enhance the expressive power of hypergraph neural networks (HGNNs), but they also intensify representation collapse in deep propagation due to strong multi-way feature mixing. This work investigates hypergraph oversmoothing from a dynamical-systems perspective and develops a reaction--diffusion framework for depth-resistant hypergraph learning. By defining hypergraph gradient and divergence operators, we interpret message passing as an incidence-level diffusion process. The analysis of pure diffusion shows that its continuous semiflow exponentially contracts the null-mode-free component of node representations and drives the Dirichlet energy to zero, revealing hypergraph oversmoothing as an intrinsic transverse-energy dissipation phenomenon. Motivated by this analysis, we propose Hypergraph Neural Reaction--Diffusion (HNRD), which introduces a reaction mechanism acting on the transverse component to compensate diffusion-induced dissipation and stabilize discriminative variations. We establish global well-posedness of the proposed dynamics and prove that the null-mode-free Dirichlet energy remains bounded away from zero. A forward-Euler discretization provides a practical HNRD layer with a stability condition for deep propagation. Experiments on benchmark and synthetic heterophilic hypergraphs demonstrate that HNRD consistently improves over representative hypergraph baselines. Depth, robustness, and efficiency analyses further show that HNRD preserves stable performance and nonzero Dirichlet energy under deep propagation and perturbations. These results provide a principled dynamical framework for designing deep hypergraph architectures that maintain higher-order expressiveness without representation collapse.

View source

Similar papers

#graph neural networks Review Sep 2026

Shaping Graph Neural Networks with Dynamical Systems

This work presents a unified dynamical-systems perspective for shaping approaches that explicitly control and regulate the degree of propagation, conservation, and dissipation of information throughout the neural flow, and highlights how neural differential equations provide a coherent theoretical framework for designi...

Alessio Gravina · 0 citations
#machine learning Preprint Sep 2026

Revisiting Spectral Representations in Generative Diffusion Models

This paper investigates the connection between self-supervised spectral representation learning and diffusion generative models through a shared perspective on perturbation kernels and finds that the optimization of the spectral alignment objective is in an equivalent form of diffusion score distillation in the represe...

Yuehao Wang, Pei-Hao Wang, Hanwen Jiang et al. · 0 citations
Jul 2026

Persistent Gaussian Perturbations Prevent Oversmoothing in Recurrent Graph Neural Networks

Analysis of a recurrent graph neural network in which independent Gaussian noise is injected after every propagation step reveals persistent stochastic perturbations as a fundamentally different mechanism for combating oversmoothing, complementing existing deterministic approaches based on residual connections, normali...

M. H. Chehreghani · 1 citation
#machine learning Preprint Aug 2026

Network Denoising Revisited: A Ricci-Flow-Inspired Graph Diffusion Method

This work proposes Ricci-Diffusion, a curvature-guided graph diffusion method inspired by Ricci flow, which exhibits a Ricci-flow-like evolution, in which relative edge-level curvature modulates local transport in the diffusion kernel and guides edge-weight updates toward a more regular graph geometry.

Ye Fang, Chuan-Xian Ren · 0 citations
Aug 2026

Controlling representation evolution in deep graph neural networks.

The Stable Reaction-Diffusion encoder (SRD) provides a trajectory-stabilizing forward evolution mechanism that explicitly controls propagation drift and finite-depth sensitivity, rather than simply stacking additional message-passing layers.

Jia-Jun Lin, Yuxin Tian, Li Feng et al. · 0 citations
Preprint Aug 2026

A Hyperfinite Framework for Score-Based Generative Modeling

This paper develops a hyperfinite formulation of score-based generative modeling within the framework of Nonstandard Analysis, and shows that minimization of an internal score-matching objective recovers the score function required by the reverse-time dynamics, thereby connecting score estimation with generative sampli...

Sunder Ram Krishnan · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.