Skip to content

PersonaDiff: diffusion-based style control for speech-synchronized 3D facial animation

Nov 2026 · Pattern Analysis and Applications · Vol 29 · 0 citations · 46 references

TL;DR

Qualitative results show that the proposed dynamic style representation enables the generation of diverse speaker-dependent facial motions under different speaking styles and is well suited for applications such as virtual avatars, digital content creation, and other digital human systems.

View source

Similar papers

Oct 2026

Audio-driven 3D Facial Animation with Multimodal Context Enhancement

Audio-driven 3D facial animation has emerged as a prominent research topic in computer graphics. Existing autoregressive methods are often slow and suffer from error accumulation, whereas non-autoregressive methods often struggle to establish global contextual dependencies. Moreover, current approaches remain insuffici...

Yan-Lei Lei, Jing Chi, Chun-Lin Zhao et al. · 0 citations

Seeing Speech: Learning Visible Articulatory Dynamics for Speech-Driven 3D Facial Animation

A novel articulation-aware framework that models visible speech through directional articulatory motions and composes them into surface-consistent 3D facial motion and integrates the predicted directional articulatory motions under mesh topology to produce surface-consistent 3D facial motion.

H. Kim, Byungchan Hwang, H. Kim · 0 citations
Preprint Oct 2026

CASE: Complementary Articulation-Aware Speech Encoder to Enhance Speech-Driven 3D Facial Animation

CAS (Complementary Articulation-aware Speech Encoder), a complementary speech encoder adapted by contrastively aligning short speech clips with continuous 3D lip-mesh VQ-VAE latents, which is consistent with cross-language downstream transfer under a shared English-pretrained audio-visual prior.

Jaehong Myung, Seungho Eum, Taegon Kim et al. · 0 citations
Open access Sep 2026

Implementation of Synchronized and Coordinated Motion in 3D Facial Animation Based on Weighted Dirichlet Algorithm

With the continuous advancement of Virtual Reality (VR) technology, people's requirements for human-computer interaction are becoming increasingly high. To achieve realistic facial expression animation in VR human-computer interaction, a method based on weighted Dirichlet algorithm is proposed to effectively synchroniz...

Hui-Dong Zhang · 0 citations
Preprint Open access Oct 2026

DynaConTalk: Wavelet-Constrained Diffusion for Long-Form and Controllable Holistic Co-Speech 3D Motion

Holistic co-speech animation is prone to averaging in both motion representation and speech conditioning. In coordinate-space diffusion, slow body posture, mid-frequency gesture strokes, and fast hand or facial details are entangled in one prediction target, often producing low-variance, over-smoothed motion. Meanwhile...

Yi-Fei Zhu, Yang-Yang Cai, Ming-Yi Shi et al. · 0 citations
Book Open access Nov 2026

Motion-Phase Collaborative Learning for Dynamic Facial Expression Recognition

Dynamic Facial Expression Recognition (DFER) in the wild remains challenging due to subtle motion cues, severe temporal redundancy, temporal misalignment, and long-tailed class distributions. While masked video modeling has shown strong potential for video representation learning, its conventional pixel-level reconstru...

Qiang-Chang Wang, Yi-Fang Hao, Yong-Feng Dong et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.