Skip to content

Conditioning Degenerate Diffusion Models

Sep 2026 · 0 citations · 35 references
Computer Science

TL;DR

This work uses causal optimal transport to define loss functions that identify a minimum-entropy control for guidance under minimal assumptions in conditioned generative models.

Abstract

Current conditioned generative models heavily rely on score functions for guidance during training. When the generative model is a diffusion process with a singular diffusion coefficient and the underlying (conditional) densities either do not exist or are not smooth, we use causal optimal transport to define \emph{approximate} loss functions that identify a minimum-entropy control for guidance under minimal assumptions. Our approach relies on causal optimal transport and its characterization through the predictable representation property of (conditioned) diffusion processes whose associated martingale problem is well posed, \`a la \"Ust\"unel.

View source

Similar papers

Preprint Sep 2026

Generative bootstrap processes

We study generative bootstrap processes obtained by resampling from fitted generative distributions. We establish necessary and sufficient conditions for their conditional weak convergence to the $P$-Brownian bridge, formulated in terms of finite-dimensional conditional weak convergence and conditional asymptotic equic...

Zi-Ming Lin, Fang Han · 0 citations
#machine learning Preprint Sep 2026

Optimal Transport Dropout for Structured Predictive Uncertainty

Optimal Transport Dropout (OTD) is introduced, which offers a way to learn structured predictive uncertainty without explicit posterior inference or ensembles of independently trained predictors.

Giacomo Lorenzon, Francesco Regazzoni · 0 citations
Preprint Aug 2026

A Plug-in Interpretation of Conditioning in Score-Based Diffusion Models

A conditioning mechanism for diffusion models based on multi-speed joint diffusion of the target and the condition learns an unconditional joint score network and enforces conditioning at inference via a plug-in correction term, and derives explicit conditional reverse-time SDEs and approximate probability-flow ODEs.

Libo Chen, Souvik Ghosh, Teo Deveney et al. · 0 citations
#machine learning Preprint Sep 2026

Simplex Diffusion Models

Simplex Diffusion Models (SDMs) are proposed, a framework that lifts the diffusion process to the probability simplex to represent beliefs over categories and can carry uncertainty across denoising steps, which mitigates information collapse.

Justin Deschenaux, Alexandre Galashov, Andrew Campbell et al. · 1 citation
#machine learning Preprint Aug 2026

Simulation-free and finite-time diffusion model

A framework for designing the reference process that achieves tractable time-dependent conditional distributions and then construct the reference process realizing them as its marginals is proposed, revealing that score matching is not fundamental to diffusion-model training but instead emerges naturally through revers...

Kentaro Kaba, Masayuki Ohzeki, Yuki Sughiyama · 0 citations
#natural language process... Preprint Aug 2026

Simplex Relaxation for Discrete Diffusion

Simplax is introduced, an exact Dirichlet--categorical augmentation that couples each corrupted categorical state with an auxiliary simplex-valued variable while preserving the original uniform diffusion process as its categorical marginal.

Jinya Sakurai, Patrick Pynadath, Satoshi Hayakawa et al. · 1 citation

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

GPT-Lab Sep 3, 2026

Adaptive AI Agents in Construction Workflows

Adaptive AI agents can help make BIM data more machine-readable by navigating IFC models, interpreting inconsistent information, and mapping it to defined standards. In this blog, Alok Rawat shares findings from a real-world pilot in construction workflows. The post Adaptive AI Agents in Construction Workflows appeared first on GPT-Lab.

GPT-Lab Aug 28, 2026

We built an AI factory for HVAC control

What does it take to trust AI-driven HVAC optimization? Our AI Model Factory combines agents, machine learning, reinforcement learning and deterministic checks in a governed workflow designed for messy, real-world building data. The post We built an AI factory for HVAC control appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.