This paper proposes a trainable Neural Cellular Automata (NCA) based surrogate model for learning long time PDE dynamics that achieves the lowest long-horizon relative errors on the majority of the experiments.
Abstract
Classical numerical solvers for partial differential equations (PDEs) are computationally expensive to solve repeatedly across varying initial conditions, motivating the need for learned surrogates. In this paper, we propose a trainable Neural Cellular Automata (NCA) based surrogate model for learning long time PDE dynamics. Rather than mapping an entire initial field to a full trajectory in one shot, our proposed model learns a small, local, homogeneous update rule that is applied identically and repeatedly at every grid cell, mirroring the locality of differential operators. We benchmark this framework against three baselines: PDE - Net, a modified physics-informed neural network (PINN), and a Fourier Neural Operator (FNO), on five canonical PDEs (heat, advection, Burgers, Allen - Cahn, and Fisher - KPP), evaluated at temporal domain two times beyond the training temporal domain. The proposed model achieves the lowest long-horizon relative errors on the majority of the experiments.
A numerical-prior-guided, physics-constrained method trained without ground-truth trajectory supervision that reduces long-time extrapolation error relative to the numerical prior and outperforms the best competing baseline in each case, thereby improving long-time simulation accuracy across different PDEs without grou...
Ma-Qun Zhang, Feng Gao, Wan-Kun Chen et al.· 0 citations
The Time-Evolving Natural Gradient (TENG) method evolves neural approximations of time-dependent partial differential equations by projecting time-discrete target states onto the neural-network manifold through local natural-gradient iterations. For stiff diffusion-dominated problems, however, explicit Runge--Kutta met...
This work explores a different formulation for coupled systems, where a neural surrogate mapping a full driving trajectory and initial condition directly to a full output trajectory is trained and where surrogate error degrades it.
Variants of physics-informed neural networks (PINNs) often treat neural networks as the main solution representation, yet solutions are encoded implicitly in high-dimensional weights, making training behavior and outcomes difficult to predict or analyze across different partial differential equation (PDE) settings. I...
The dynamics of cells, organisms, and fluids are often modeled as probability distributions evolving over time. Reconstructing and extrapolating this evolution from unpaired snapshots requires assumptions about the underlying process. Wasserstein gradient flows are a common choice, but they cannot describe conservative...
F. Sergeev, Markus Heinonen, Daniel Waxman et al.· 0 citations
Any-dimensional machine learning models, such as graph neural networks (GNNs), can be naturally trained and evaluated on inputs of different sizes and dimensions. Inspired by the GNN transferability literature, we show mathematical conditions under which a partial differential equation (PDE) learning-based solver can b...
Wilson G. Gregory, G. Kevrekidis, Ben Blum-Smith et al.· 0 citations
Learn how Google DeepMind and GovTech Singapore uses lightweight on-device Gemma models to intercept conversational scams in private chats with zero cloud data egress.