Skip to content
Preprint

Information-Computation Inversion in Pseudo-Marginal MCMC

Aug 2026 · 0 citations
Mathematics

TL;DR

An inverse-weight acceptance bound is derived that yields a lower bound on functional mean-squared error from high retained-weight mass in discrepant states and distinguishes statistical information, retained-state functional risk, and auxiliary-computation allocation in pseudo-marginal inference.

Abstract

Pseudo-marginal MCMC is exact under nonnegative unbiased likelihood estimation, but observation design can change both posterior information and the stochastic law of the likelihood estimator. We study fixed-horizon recovery of a declared posterior functional under this joint change. For a broad fresh-estimator pseudo-marginal class, we derive an inverse-weight acceptance bound that yields a lower bound on functional mean-squared error from high retained-weight mass in discrepant states. A two-region corollary establishes an information-computation inversion: stronger exact posterior separation can coexist with worse finite-horizon recovery when the estimator law changes. The obstruction motivates an exact route-conditioned transition that allocates coupled auxiliary inheritance and independent refreshment according to a scientific pair route. In a controlled transcription experiment, a finer observation strengthens likelihood separation while degrading particle-filter reliability and finite-chain behavior. In a fresh 96-state gene-network comparison, route conditioning reduces measured particle-filter wall time by 42.4% in the frozen execution (95% retained-state bootstrap interval 39.6%-45.2%). Recovery uncertainty spans the predeclared noninferiority margin. A prospective Lotka-Volterra experiment supports portability of the retained-state route-restoration mechanism. The results distinguish statistical information, retained-state functional risk, and auxiliary-computation allocation in pseudo-marginal inference.

View source

Similar papers

Preprint Aug 2026

Scalable Statistical Inference in Stochastic Gradient Descent

The proposed methodology delivers interpretable, simultaneous hyper-rectangular confidence regions that are statistically robust, memory-efficient, and strictly scalable for high-dimensional inference.

Rahul Singh, A. Shukla · 0 citations
Preprint Sep 2026

Subsampled Pseudo-posteriors for Scalable Bayesian Moment-condition Inference

A new family of subsampled pseudo-posteriors is developed that replaces the full-data pseudo-posterior with an aggregate of mini-batch pseudo-posteriors and establishes finite-sample total variation bounds to the full-data pseudo-posterior, allowing discontinuous and intractable moment functions.

Wen-Shuo Zhao, Rong Tang · 0 citations
Preprint Aug 2026

Bessel-Debiased Pseudo-Marginal MCMC for Generalised Bayesian Inference

Sign-Corrected Bessel Debiasing (SCBD), a signed pseudo-marginal method based on independent block estimates of the loss, is introduced and its ordinary-MC and independently randomised quasi-Monte Carlo (RQMC) implementations are studied.

Yingkai Lu, J. Lee, Geoff K. Nicholls · 0 citations
Preprint Jul 2026

Regularized-Likelihood Deconvolution with Posterior-Density Reconstruction

Density deconvolution is an ill-posed inverse problem, as recovering the latent distribution amplifies high-frequency noise in the observed data. We propose a two-stage likelihood-based procedure. The first estimator maximizes the convolution likelihood over a regularized Gaussian-mixture sieve, while the second reuses...

M. Marzio, S. Fensore, Chiara Passamonti et al. · 0 citations
Preprint Aug 2026

Parameter estimation in Conditional Sequential Monte Carlo algorithms through Particle Learning

The p(parameter)-CSMC algorithm is proposed, which incorporates both parameter learning and ancestor sampling, leading to much better mixing properties compared to (particle) Gibbs sampling in settings where strong internal correlations may challenge effective exploration.

A. D. Palomares, G. Storvik · 0 citations
Preprint Aug 2026

Exploiting Exact Conditionals Improves Conditioning: Provably Fast Mixing Time Bounds By Sampling from the Marginal

The problem of sampling from a probability distribution arises in many applications such as posterior sampling in hierarchical Bayesian inverse problems and Gaussian processes for machine learning. Markov chain Monte Carlo (MCMC) algorithms are often used for sampling from a target probability distribution, but impleme...

Abhijit Chowdhary, Federica Milinanni, Julianne Chung et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.