Skip to content

Author

Yu-Sheng Dai

We have 5 of 9 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Nov 2026

LiveFoley: Dynamic Real-Time Video-to-Audio Generation for Immersive Interactive Worlds

A Trailing Sliding Window that converts non-causal segment-level encoders into streaming modules without retraining and a Trailing Sliding Window that converts non-causal segment-level encoders into streaming modules without retraining is introduced.

Yu-Sheng Dai, Vladimir E. Iashin, Kang-Di Wang et al. · 0 citations
Book Aug 2026

CineDub: Scaling End-to-End Video Dubbing to Multi-Speaker Dialogues with Coherent Sound Effects

CineDub is a unified diffusion-based model that achieves precise multi-speaker dialogue dubbing directly from uncropped videos, without face cropping or speaker diarization, and introduces an Ambient-to-Linguistic Curriculum Learning (ALC) to mitigate sub-task degradation, and a decoupled textual branch control mechani...

Yu-Sheng Dai, Kang-Di Wang, Bao-Long Gao et al. · 3 citations
Preprint Aug 2026

Fourier is Frontier: Frequency-Aware Autoencoding for High-Fidelity Music Reconstruction

Continuous-latent audio autoencoders form the backbone of latent music generators, yet decoders at high compression rates commonly exhibit three failure modes: high-frequency loss, phase incoherence, and stereo-image collapse. These share a structural root: waveform autoencoders lack an explicit frequency axis, leaving...

Kangdi Wang, Yu-Sheng Dai, Jin Xu · 0 citations
Sep 2026

Self-Aligned Forcing: Streaming Video Diffusion with Differentiable Noisy History

Autoregressive video diffusion enables interactive streaming generation, but suffers from error accumulation over long rollouts. Self-rollout training reduces exposure bias, yet finite rollouts leave long-range drift unresolved. We observe that the noise level of the history key-value (K/V) representations trades visua...

Weiqiang Wang, Zhuo-Kun Chen, Yu-Sheng Dai et al. · 1 citation
Preprint Aug 2026

Visual Representation Matters: Exploiting Temporal Differences in Video-to-Audio Generation

This work introduces TD-V2A, which leverages temporal differences (TD) as the key representation that distinguishes V2A from I2A, enriching visual conditioning with minimal architectural modification and significantly improves end-to-end V2A generation quality, even outperforming dedicated V2A representations such as c...

Zehua Chen, Junyou Wang, Yuxuan Jiang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.