Skip to content

When Can You Correct Distribution Drift in Temporal Graph Generation? A Sharpening-Drift Tension and an Impossibility for Observation-Based Correction

Jul 2026 · arXiv.org · Vol abs/2607.24662 · 0 citations · 13 references
Computer Science

TL;DR

It is proved that any corrector measurable with respect to past observations leaves at least the conditional variance of the statistic it tracks, and that trend extrapolation beats trusting the last observation only when $\mu^2>v(1-2\rho)$.

Abstract

Generative models of temporal graphs are trained on one stretch of an evolving network and deployed on the next, and they degrade badly in the gap. We show this degradation is derivable, general, and not fixable from observations. The masked flow-matching loss decomposes exactly, with no independence assumption, into an irreducible entropy plus a divergence whose derivative along the training path is positive precisely for structures rare during training and common at deployment, diverging as their training probability goes to zero. Empirically the trade-off is a power law with exponent $-0.605$ ($R^2=0.9977$), and drift raises the sampler's error floor without changing how many steps reach it: across seven well-powered conditions the drift-period marginal error varies by at most $6\%$ over a $50\times$ range of sampling budgets, while the floor sits $2.2\times$ to $34.3\times$ above the in-period floor. Because the deployment period is observed, correction looks like a matter of measurement. It is not. We prove that any corrector measurable with respect to past observations leaves at least the conditional variance of the statistic it tracks, and that trend extrapolation beats trusting the last observation only when $\mu^2>v(1-2\rho)$. Both premises are measurable and both go the wrong way: the drift is trendless and mean-reverting, with a one-step innovation as large as the drift itself. An oracle removes $60\%$ of the error, the best observation-based corrector recovers $5.7\%$ of that, and extrapolation is strictly worse than doing nothing clever.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Let It Go or Learn to Self-Correct: Continuous Diffusion for Constrained Discrete Tasks

Denoising Diffusion Probabilistic Models (DDPMs) generate samples by starting from noise and repeatedly denoising while keeping each update close to the current noisy state. This behavior is effective in many continuous domains, but its role is less clear for globally constrained discrete tasks, such as Sudoku, graph c...

M. Drozdova, Stéphane Liem Nguyen, François Fleuret · 0 citations
#artificial intelligence Preprint Sep 2026

Limits of Confidence in Diffusion

It is shown that a step matches the training distribution only when the positions it writes are conditionally independent given the tokens already fixed, that no product of per-position distributions can match a dependent group, and that per-position distributions do not determine whether a group is dependent.

Russ Webb, Amitis Shidani, Alice Bizeul et al. · 1 citation
#natural language process... Preprint Aug 2026

Simplex Relaxation for Discrete Diffusion

Simplax is introduced, an exact Dirichlet--categorical augmentation that couples each corrupted categorical state with an auxiliary simplex-valued variable while preserving the original uniform diffusion process as its categorical marginal.

Jinya Sakurai, Patrick Pynadath, Satoshi Hayakawa et al. · 1 citation
Open access Jul 2026

Fraud learns too: continual graph learning under strategic adversarial drift in dynamic networks

Game Theoretic Anticipatory Continual Graph Learning (GT-ACGL), a framework that casts fraud detection as a continuous Stackelberg game between a defender and an adaptive adversary, and encourages decision boundaries that remain comparatively stable under strategic structural perturbation.

Hui-Jie Fan, Ya-Nan Jiao, M. Wang et al. · 2 citations
#small language model Review Sep 2026

Fine-Tuning Fixes Mode Collapse and Over-Dispersion in LLMs

This work derives a bias-variance decomposition of the expected gap between the model's and target's collision probabilities, showing that SFT is not inherently biased toward mode collapse or its opposite, and shows that diversity miscalibration can arise from finite-sample error and shrink as SFT better approximates t...

K. Skobelev, Eric Fithian, X. Y. Han · 0 citations
Jul 2026

Mean-to-Score Discrete Diffusion: Posterior-Mean Denoisers for Score Entropy

A 170M-parameter M2S model trained on about 262B OpenWebText token slots outperforms the evaluated pure-uniform SEDD, GIDD, and Neural CTMC checkpoints at every tested sampling budget, reaching generative PPL $143.3$ at 128 steps versus $183.6$ for the strongest pure-uniform baseline.

Jing-Yuan Li, Xiaoyi Jiang, Yi-Xuan Jiang et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.