Skip to content

Distribution-Alignment Bridge for Uncertainty-Aware Text-to-Video Retrieval

Jul 2026 · arXiv.org · Vol abs/2607.20984 · 0 citations · 32 references
Computer Science

TL;DR

This paper proposes the Distribution-Alignment Bridge (DAB), a framework that reconceptualizes text-to-video retrieval as a distribution alignment task rather than traditional deterministic point matching, and introduces a distribution-aware contrastive loss based on Kullback-Leibler divergence.

Abstract

This paper proposes the Distribution-Alignment Bridge (DAB), a framework that reconceptualizes text-to-video retrieval as a distribution alignment task rather than traditional deterministic point matching. By modeling both text and video embeddings as Gaussian distributions defined by mean and variance, DAB explicitly accounts for modality-specific uncertainty. We employ a deterministic, diffusion-inspired bridge to iteratively refine text distributions toward their target video distributions through a truncated refinement process. This approach unifies probabilistic embedding and distributional transformation into a cohesive, end-to-end trainable system. To optimize cross-modal similarity, we introduce a distribution-aware contrastive loss based on Kullback-Leibler divergence. Extensive evaluations on MSR-VTT, MSVD, and VATEX benchmarks confirm that DAB significantly outperforms existing probabilistic and diffusion-based baselines, while providing calibrated uncertainty-aware ranking through bridge-induced distributional margins.

View source

Similar papers

Open access Aug 2026

Dynamic Uncertainty Learning with Noisy Correspondence for Text-based Person Retrieval

Dynamic Uncertainty with Noisy Correspondences (DUNC), a novel framework that incorporates two key components that incorporates Cross-modal Evidential Learning (CEL), which models bidirectional alignment uncertainty using a Dirichlet distribution to capture the confidence in image–text similarity, and Dynamic Robust Lo...

Ze-Qun Xie, Chu-Xin Wang, Si-Hang Cai et al. · 0 citations
Conference Open access Sep 2026

Re-Weighting Cross-Modal Pairs via Rank Consistency for Noise-Robust Retrieval

A novel semantic matching degree estimation method based on ranking consistency that reweights the training paris by measuring the Normalized Discounted Cumulative Gain (NDCG) between its cross-modal and intra-modal retrieval results.

Wei-Ran Pan, Wei Wei · 0 citations
Open access 2026

Semantic-Aware Consistency Rectification for Cross-Modal Person Retrieval

This approach introduces a Paired-Guided Consistency Rectification (PCR) module that utilizes strictly paired data as reliable anchors to dynamically calibrate the confidence of unpaired samples, effectively suppressing noise from inconsistent associations under mild-to-moderate corruptions.

Zi-Xuan Zhang, Lu-Ming Xiao · 0 citations
#machine learning Preprint Sep 2026

Unifying Distributional Training for One-Step Visual Generation

A unified theoretical framework is introduced that separates distribution modeling from matching discrepancy and connects global objectives to pointwise feature updates through Wasserstein gradient flow and motivates MGFlow, which models feature distributions with Gaussian mixtures at an adjustable granularity between...

Chi Zhang, Hao-Yan Shi, Yue-Yi Liu et al. · 2 citations
Conference Aug 2026

Noun Presence Loss with Dynamic Weighting for Compositional Text-to-Image Generation

Compositional text-to-image generation requires faithful depiction of multiple objects with distinct visual attributes. While recent inference-time optimization methods have substantially improved attribute binding, entity neglect - where specified objects are absent from the generated image - remains an unresolved fai...

Trong-Tai Dam Vu, Vinh-Tiep Nguyen · 0 citations
Aug 2026

CATSANet: cross-modal semantic token selection and optimal transport based part alignment for text-to-image person ReID

The proposed Cross-Modal Adaptive Token Selection and Alignment Network (CATSANet), a CLIP-based framework tailored for TI-ReID, achieves competitive performance in terms of Rank-k accuracy and mAP, demonstrating the effectiveness of fine-grained alignment and ranking refinement across datasets.

Dongbin Chen, Junjie Li, Hao Xu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.