Ji-Wang Zheng

ETHead: Generating Expressive 3D Facial Animation and Head Movement from Speech

A self-distillation framework that leverages large-scale 2D talking videos to pre-train a specialized speech encoder that aligns speech representations with expressive visual dynamics, allowing the encoder to extract features highly correlated with facial and head motions directly from audio.