WanPE formulates shot-level cinematic plans via video-grounded reverse construction and employs Semantic-Consistency GRPO (SC-GRPO) to faithfully preserve user requirements across shots and over time, leading all evaluated commercial offerings at 5-15 seconds and remains competitive with Seedance 2.5 at 30 seconds.
Abstract
Video generation begins in text space by authoring a cinematic screenplay, then materializes into pixels. As contemporary video generators scale to 30 seconds and faithfully follow complex conditions, the textual prompt largely directs the production, planning how actions, camera trajectories, lighting, and sound unfold across multi-shot sequences. In this paper, we present WanPE, a 397B-parameter prompt enhancement model trained on 1.05M real-world videos to master director-level cinematic planning. WanPE formulates shot-level cinematic plans via video-grounded reverse construction and employs Semantic-Consistency GRPO (SC-GRPO) to faithfully preserve user requirements across shots and over time. To benchmark this capability, we curate WanPEval, a human-annotated testbed covering durations from 5 to 30 seconds across varying intent granularities, supported by approximately 11K blind pairwise assessments. When powering Wan3.0's video generator, WanPE-397B boosts human preference over raw user prompts by 10.66-18.84 points at 5-15 seconds and by a dramatic 50.86 points in the 30-second arena. Ablation studies show that reverse construction demonstrates clear superiority over forward rewriting, while SC-GRPO robustly preserves semantic fidelity across model scales. Ultimately, WanPE leads all evaluated commercial offerings at 5-15 seconds and remains competitive with Seedance 2.5 at 30 seconds.
An automated evaluation pipeline with human alignments that separately assesses text fidelity through carrier-specific transcription and scene and motion requirements through a prompt-specific chain of query and a Director agent coordinates image and video generation with visual evaluation, guiding iterative refinement...
Yu Huang, Jun-Gang Li, Zhiyuan Wang et al.· 3 citations
CinematicVQA is introduced, the first-of-its-kind benchmark for cinematic video understanding that goes beyond technique recognition to evaluate film-grammar reasoning, utilizing the introduced Cinematic Scene Graph (CSG), a structured representation that links filming techniques to their perceptual effects and narrati...
Shuo Xing, Pooja Verlani, Balu Adsumilli et al.· 0 citations
Generative video systems can produce short clips from textual and visual instructions, yet their ability to preserve the content of a human reference remains uncertain. This exploratory study examines 160 videos generated with Doubao-Seedance-2.0 from 40 human-made short-form videos drawn from Douyin and Xiaohongshu. T...
Chloe Zihan Jin· Communications in Humanities...· 0 citations
Results indicate that cinematic video assessment benefits from jointly modeling low-level fidelity, temporal continuity and high-level narrative alignment, especially for synthetic clips whose visual realism and semantic plausibility fail in different ways.
Yan-Xiu Dan, Yu-Heng Li· Applied Sciences· 0 citations
Quantitative and qualitative evaluations on multi-shot story generation demonstrate that the Complementary Retrieval-Augmented Prompting method consistently outperforms recent-frame, memory-based, and entity-level retrieval baselines in cross-shot consistency and text-controllability.
Xiang-Han Wei, Xiao-Da Yang, Zhi Wang et al.· arXiv.org· 0 citations
This work introduces a new formulation of AD generation in which models must jointly decide what to describe and when to do it, and presents REFRAMED, a high-quality dataset of 2,023 videos that span 3,302 scenes from 206 movies, with professional AD transcripts, professional subtitles and aligned screenplays.
Igor Sterner, Mirella Lapata, A. Lascarides et al.· 2 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.