Streaming digital humans produce detailed video while continuing speech as new text arrives. High-resolution denoising is costly, and text updates can cause repeated or interrupted speech. We present TaoMate-HD, an autoregressive model for high-resolution audio-video streaming. For each short segment, or chunk, two den...
Qi-Jun Gan, Chen-Wei Zhang, Xin-Yang Li et al.· 0 citations
Streaming multi-reference video generation establishes a scene from specified people and objects, then continues it under changing instructions. We introduce TaoMate-R1, a streaming multi-reference generator that organizes adaptation parameters through temporal role specialization. It assigns separate low-rank adapters...
Qi-Jun Gan, Chen-Wei Zhang, Xin-Yang Li et al.· 0 citations
Low-quality facial videos suffer from missing fine details, while AI-generated videos may additionally contain implausible teeth and lip movements that do not match the speech. Restoring the mouth region is particularly challenging: enhancing existing details can preserve structural errors, whereas regenerating them ri...
Xin-Yang Li, Ze Xu, Jing-Na Sun et al.· 0 citations
Results show that \method preserves stable appearance across prompt-conditioned segments and strong audio-visual synchronization under autoregressive generation, accelerating autoregressive inference without pipeline-specific retraining.
Qijun Gan, Chen-Wei Zhang, Mei-Guang Jin et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.