Skip to content
#diffusion models Conference Open access

AI-Driven 3D/4D Content Generation, Editing, and Animation Using Diffusion Models and Gaussian Splatting: A Narrative Review

Sep 2026 · Exploring Science Academic Conference Series · 0 citations · 28 references
Generative Adversarial Networks and Image Synthesis

TL;DR

This narrative review syn thesizes representative works published between 2023 and 2025 across four interconnected sub-areas: text-to-3D/4D generation, 3D scene editing, dynamic scene animation, and motion and video generation.

Abstract

The convergence of diffusion models and 3D Gaussian Splatting (3D -GS) has catalyzed a paradigm shift in AI-driven 3D/4D content creation, enabling high-quality generation, editing, and animation from natural language instructions. This narrative review syn thesizes representative works published between 2023 and 2025 across four interconnected sub-areas: text-to-3D/4D generation, 3D scene editing, dynamic scene animation, and motion and video generation. Through comparative analysis of representation types, supervision strategies, and temporal modeling approaches, we identify convergent design principles—coarse- to-fine optimization in distillation-based methods, explicit representations, regularization against score - distillation variance, and decomposition for controllability—that recur across sub-areas. We catalog six critical limitations and propose concrete directions for improvement for each. This review serves as a foundational reference for researchers entering this rapidly evolving field.

Read PDF

Similar papers

Apr 2026

AnimateAnyMesh++: A Flexible Feed-Forward Framework for High-Fidelity Text-Driven Mesh Animation.

AnimateAnyMesh++ is presented, a feed-forward framework for text-driven animation of arbitrary 3D meshes with substantial upgrades in data, architecture, and generative capability, and demonstrates that AnimateAnyMesh++ generates semantically accurate and tem porally coherent mesh animations within seconds, surpassing...

Zijie Wu, Chao-Hui Yu, Fan Wang et al. · 3 citations · ⚡1
Oct 2026

Motion Controlled Text-to-4D Generation with Multi-View Video Diffusion Model.

Recent advances in 2D and 3D generative modeling have paved the way for 4D generation. However, existing methods predominantly focus on text-to-4D generation, emphasizing temporal smoothness and spatial consistency while often neglecting precise motion control. Furthermore, due to the inherent ambiguity of text descrip...

Run-Xin Liu, Yang Chen, Ying-Wei Pan et al. · 0 citations
Open access Aug 2026

Text-to-hierarchical three-dimensional scene generation: a new approach for layered three-dimensional modeling from natural language

An end-to-end hierarchical framework for text-to-3D scene generation that synergistically integrates state-of-the-art components for video synthesis and mesh reconstruction is introduced, offering a powerful solution for applications, such as virtual reality and digital twins.

Zuan Gu, Tian-Han Gao, Lang-Xu Zhao et al. · 0 citations
Open access Aug 2026

SPL4SH: Designing a Systematic Pipeline for 4D Synthetic Humans in XR Content Creation

SPL4SH contributes a grounded framework for selecting, combining, and evaluating independent generative components as XR-ready synthetic human assets and shows that modular 4D human generation is technically feasible.

David Ohara de Souza Cardoso, Willams de Lima Costa, Pedro Azevedo Abrantes de Oliveira et al. · 0 citations
Sep 2026

MeshSeqGen: Zero-shot Mesh Animation based on a Large Video Generation Model.

MeshSeqGen is introduced, a zero-shot framework that simplifies this process by using the motions from generated video frames to guide mesh deformation, and its mesh-based Gaussian representation ensures the final animations are both plausible and structurally consistent.

Yun-Peng Xiao, Jie Yang, Chuan Li et al. · 0 citations

Related blog posts

Google DeepMind Blog Nov 18, 2026

Genie 4 is now available

We are rolling out a new Project Genie experience to eligible Google AI Ultra subscribers, opening access to our new Genie 4 world model.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.