Skip to content

High-Dimensional Simulation-Based Inference in Latent Spaces

Sep 2026 · arXiv.org · Vol abs/2609.37381 · 0 citations · 56 references
Computer Science Mathematics

TL;DR

This work describes the conditions under which latent-space inference recovers the desired target posterior and systematically study its empirical trade-offs, comparing latent and standard estimators while controlling for network capacity, regularization, optimization, and training compute.

Abstract

Neural simulation-based inference (SBI) has been widely successful in inferring a relatively small number of interpretable parameters from potentially high-dimensional observations, such as images or time series. Accordingly, representation learning in SBI has focused almost exclusively on compressing the observations used to condition the posterior. More recently, however, SBI has begun to target increasingly high-dimensional parameter spaces, raising the complementary question of whether the inference target itself should be compressed. Our answer is a practical merger of SBI and latent generative modeling, which learns a low-dimensional representation of the simulator parameters, performs posterior inference directly in this latent space, and maps posterior samples back to the original parameter space. We characterize the conditions under which latent-space inference recovers the desired target posterior and systematically study its empirical trade-offs. Across four case studies and three generative families, we compare latent and standard estimators while controlling for network capacity, regularization, optimization, and training compute. At matched training compute, latent-space inference achieves accuracy and marginal calibration comparable to direct target-space inference while sampling up to more than an order of magnitude faster.

View source

Similar papers

Preprint Oct 2026

Neural Estimation of Summary Statistics for Simulation-Based Inference with Non-Asymptotic Guarantees

This work highlights summary learning as a critical component of SBI and proposes a general framework that jointly learns a neural-network-parameterized summary and an amortized posterior estimator, and introduces a local refinement strategy that adapts the amortized estimator to a specific observation, thereby reducin...

Rui Li, Rong-Tong Tang · 0 citations
#machine learning Preprint Nov 2026

Shrinkage prior for implicit generative models

Implicit generative models based on deep neural networks have revolutionized many scientific fields, from weather research to language generation. They successfully model complex random objects arising in real-world problems. In this work, we propose a sample-efficient training mechanism for these models. Our approach...

Shreya Sinha Roy, Christian P. Robert, Ritabrata Dutta · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.