Skip to content
Preprint

A Simple Example of Bayesian Nonparametric Inconsistency

Jul 2026 · 0 citations · 16 references
Mathematics

Abstract

I present a very simple example in which a full-support prior over distribution functions has an inconsistent posterior, which I believe has instructive value. The example is $Y_i \stackrel{\text{iid}}{\sim} P_0$ under the Bayesian hierarchical model $[Y_i \mid P] \stackrel{\text{iid}}{\sim} P$ and $P \sim \int \mbox{DP}(\alpha, H) \, \pi_\alpha(\alpha) \ d\alpha$ when $\pi_\alpha(\cdot)$ has exponential (or heavier) tails, where $\mbox{DP}(\alpha, H)$ denotes a Dirichlet process with concentration parameter $\alpha$ and mean $H(\cdot)$; on the other hand, consistency is obtained under a light-tailed prior. This unifies and generalizes a consistency result of Freedman and Diaconis (1983) with an inconsistency result described by Ferguson et al. (1992).

View source

Similar papers

Preprint Oct 2026

Efficient Posterior Sampling for $\mathbb Z_2$ Synchronization

Consider the $\mathbb Z_2$ synchronization problem \[ \boldsymbol{Y} = \frac{\lambda}{\sqrt n} \theta\theta^{\top} + \boldsymbol{Z}, \] where $\theta$ is uniform on $\{-1,1\}^n$ and $\boldsymbol{Z}$ is an independent Gaussian Wigner matrix with off-diagonal variance one. We give a polynomial-time posterior sampling alg...

Zhang-Song Li · 0 citations
#machine learning Preprint Oct 2026

Sharp dimensional analysis of midpoint methods for Langevin sampling

The proofs exploit cancellation at stationarity and smoothing using techniques from Malliavin calculus, outperforming previous upper bounds based on standard couplings and shows surprisingly that in high dimensions, deterministic discretizations can outperform their random counterparts.

Fan Chen, Sinho Chewi, Jian-Feng Lu et al. · 0 citations
#machine learning Preprint Sep 2026

Parameter-Free Interval-Dynamic Regret under Heavy-Tailed Noise

We study online convex optimization with one unbiased stochastic subgradient per round and an unknown finite conditional $p$th noise moment, $1<p\le2$. For every fixed interval $I$ of length $n$ and comparator path with $\Lambda_I=1+P_I/D$, one learner achieves \[ E[Regret_I(u)]\le\min(GDn, C[GD\sqrt{n(\Lambda_I+\log^2...

Vaneet Aggarwal · 0 citations
Preprint Sep 2026

Finite-sample nonparametric mean tests: Leave-one-out duality and asymptotic optimality

We study finite-sample valid tests of the one-sided mean hypothesis $H_0:\mu\leq 1$ against $H_1:\mu>1$ for nonnegative random variables. To do so, we develop a leave-one-out dual certificate framework, where certain pointwise inequalities imply p-value validity under the conditional mean null $\mathbb{E}[X_i\mid\mathb...

Yi-Fan Zhu, John C. Duchi · 0 citations
Preprint Sep 2026

When Is a Relevance Threshold Statistically Resolvable? Minimax Limits for Effect Classification

Statistical precision and scientific relevance operate on different scales. In regular problems, sampling uncertainty contracts at rate $n^{-1/2}$, whereas the magnitude below which an effect is scientifically negligible may be fixed or may vary with information. Let $\Delta_n$ denote a relevance threshold and $I_0$ Fi...

Subir Hait · 0 citations
Preprint Sep 2026

A large-deviation principle for the empirical distribution of a regular branching random walk

Let \(\{Z_n\}_{n\geq0}\) be a supercritical branching random walk with deterministic rooted \(b\)-ary tree, \(b\geq2\), and symmetric displacements satisfying \(\lim_{x\to+\infty}x^{-\alpha}\log\Pp(X>x)=-\lambda \) with \(\alpha,\lambda>0\). Set $\overline Z_n(\cdot):=Z_n(\cdot)/Z_n(\mathbb{R}),~n\geq0.$ For a finite u...

Shu-Xiong Zhang, Ya-Ping Zhu · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.