Skip to content

Gradient Estimation for Mixture Variational Inference

· 0 citations · 39 references

TL;DR

This work provides an elementary derivation of a single-sample post-stratified estimator—previously derived via transport equations—and proves a variance reduction relative to simple random sampling, expanding the applicability of implicit reparameterization and reducing its computational complexity.

View source

Similar papers

#machine learning Preprint Sep 2026

Variational Mixtures and Multi-Marginal Flow Matching: Advancing Statistical Inference with Biological Applications

In this thesis I develop methods for statistical inference when the distributions arising from complex biological systems are multi-modal, geometrically structured, and sometimes only defined up to a normalizing constant. I start from variational inference and, when analytic update equations are unavailable, move to bl...

Oskar Kviman · 0 citations
#machine learning Preprint Sep 2026

Locally Private Inference for Riemannian Stochastic Optimization

The central limit theorem and consistency of the fully transcript-based sandwich covariance and intrinsic Wald region under local differential privacy are proved and the predicted decrease in estimation error and near-nominal coverage under moderate privacy is supported.

Xiao-Tian Chang, Yang-Di Jiang, Qi-Rui Hu · 0 citations
#machine learning Preprint Oct 2026

Optimal Momentum Methods for Stochastic Multilevel Compositional Optimization

A momentum-based estimator with mini-batches is employed to track the function values of each level, which are subsequently used to construct momentum gradient estimators, and a batch-free method that incorporates a first-order approximation and a clipping technique for function value estimation is developed.

Wei Jiang, Rui Yan, Si-Fan Yang et al. · 0 citations
Preprint Aug 2026

Scalable Statistical Inference in Stochastic Gradient Descent

The proposed methodology delivers interpretable, simultaneous hyper-rectangular confidence regions that are statistically robust, memory-efficient, and strictly scalable for high-dimensional inference.

Rahul Singh, A. Shukla · 0 citations
Preprint Sep 2026

Gaussian Comparison Theorems for High-Dimensional Posterior Inference

We develop a Gaussian comparison theory for posterior inference in non-Gaussian high-dimensional models. The framework allows for model misspecification and does not require the posterior distribution itself to be approximately Gaussian. Working directly with likelihood processes on separable function spaces, we establ...

Wen-Xuan Zou, Galen Reeves · 0 citations
Preprint Sep 2026

Adaptive inference for functionals of M-estimands

Reinforcement learning and contextual bandit algorithms have become increasingly common in sequential decision-making applications. When these methods are deployed in high-stakes domains, there is growing interest not only in learning effective policies, but also in conducting statistical inference for quantities learn...

James Leiner, Aurélien F. Bibaut, Nathan Kallus et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.