Skip to content
Preprint

Stability of Finite-Batch Particle Mean-Field Variational Inference Beyond Strong Convexity

Aug 2026 · 0 citations · 39 references
Mathematics Computer Science

TL;DR

A non-asymptotic Wasserstein stability bound is proved that separates initialization, product-empirical approximation, finite-batch drift error, time discretization, and the defects accumulated along the coupled trajectories.

Abstract

We study the implementable finite-batch particle algorithm for mean-field variational inference as a fully discrete stochastic approximation of the projected Wasserstein dynamics. The target potential is globally smooth but need not be strongly convex. The departure from contractivity is quantified by the curvature defect \[ \mathfrak d_\alpha(x,y) = \bigl[\alpha\|x-y\|^2- \langle\nabla V(x)-\nabla V(y),x-y\rangle\bigr]_+, \] which is the additive loss in the one-step Euler contraction estimate. We prove a non-asymptotic Wasserstein stability bound that separates initialization, product-empirical approximation, finite-batch drift error, time discretization, and the defects accumulated along the coupled trajectories. Under the uniform bound $\mathfrak d_\alpha\leq\beta$, the particle iterates remain within $O(\sqrt{\beta/\alpha})$ of any MFVI minimizer, up to explicit errors in the particle number, batch size, and step size. The proof uses a stationary comparison array whose population law is an MFVI minimizer but whose particle-level law is a random product empirical measure, and it controls the resulting projected-drift discrepancy explicitly. We also give coordinatewise defect estimates and structural conditions for dimension-independent projected-drift sensitivity, construct an arbitrary-dimensional smooth nonconvex benchmark with a closed-form MFVI minimizer, and explain why polynomially growing drifts require a modification of the untamed explicit scheme.

View source

Similar papers

#machine learning Preprint Oct 2026

Gradient-Free Sampling from Generative Models via Stochastic Bounded Extremum Seeking

We introduce a sampling approach for energy- and score-based generative models that requires no gradient evaluations of the model. Replacing the drift term that would normally contain the score $\nabla_\mathbf{x} \log p_\theta(\bf{x})$ with a high-frequency dithered cosine of the model's \textit{value}, $\sqrt{\alpha\o...

A. Scheinker · 0 citations
Preprint Oct 2026

Spectral gap for the stochastic primitive equations under degenerate Brownian forcing

We prove a weighted Wasserstein spectral gap for the three-dimensional primitive equations on $\mathscr E=\{u\in H^1\cap L^8: \partial_zu\in L^4\}$ under finite-rank additive Brownian forcing that is phase-complete finite Fourier and satisfies a quantitative quadratic saturation condition. In particular, four real forc...

Qu-Yuan Lin, Rong-Chang Liu, Ke-Ning Lu · 0 citations
#machine learning Preprint Sep 2026

Sharp Convergence and Sampling Trade-offs for Riemannian Diffusion under Nonnegative Ricci Curvature

This work develops a general framework that separates score discretization from Brownian-motion simulation and allows multiple geodesic random-walk steps per score evaluation and provides a sharper characterization of the convergence and sampling complexity of Riemannian diffusion models.

Yu-Hao Liu, Long-Bo Huang · 0 citations
Preprint Sep 2026

Large deviations for sparse systems of moving particles

We study large deviations for rare clusters in sparse systems of moving particles. In the regime \(nr_n^d\to0\) and \(\rho_{k,n}=n^kr_n^{d(k-1)}\to\infty\), we prove a large deviation principle for the empirical measure of isolated \(k\)-particle trajectory clusters. The speed is \(\rho_{k,n}\), and the rate function i...

Cai-Rui Duan, Paula de Dios Andres, Manish Pandey et al. · 0 citations
Preprint Sep 2026

Sharp regularity and small ball probabilities for the stochastic heat equation on bounded domains

We consider the stochastic heat equation $\partial_t u(t,x) = \Delta u(t,x) + \dot{W}_\alpha(t,x)$ on a bounded Lipschitz domain with zero Dirichlet boundary condition and zero initial condition, where $\dot{W}_\alpha$ is a Gaussian noise that is white in time and whose spatial covariance is the kernel of $(-\Delta)^{-...

Jing Hu, Cheuk-Yin Lee · 1 citation
Preprint Oct 2026

The mixing time of Mean-Field Gibbs-Ornstein-Uhlenbeck processes

We introduce mean-field Gibbs--Ornstein--Uhlenbeck (MFGOU) processes, a class of discrete-time Markov processes with increments of order $1/n$, whose conditional means approximate a smooth vector field. If the field has a unique attracting zero and satisfies a global Lyapunov condition, we prove \[ \tau_{\mathrm{mix}}...

J. Jonasson · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.