Skip to content

WanPE: Towards Cinematic Prompt Enhancement for Modern Text-to-Video Generation

Sep 2026 · arXiv.org · Vol abs/2609.30221 · 4 citations · 28 references
Computer Science

TL;DR

WanPE formulates shot-level cinematic plans via video-grounded reverse construction and employs Semantic-Consistency GRPO (SC-GRPO) to faithfully preserve user requirements across shots and over time, leading all evaluated commercial offerings at 5-15 seconds and remains competitive with Seedance 2.5 at 30 seconds.

Abstract

Video generation begins in text space by authoring a cinematic screenplay, then materializes into pixels. As contemporary video generators scale to 30 seconds and faithfully follow complex conditions, the textual prompt largely directs the production, planning how actions, camera trajectories, lighting, and sound unfold across multi-shot sequences. In this paper, we present WanPE, a 397B-parameter prompt enhancement model trained on 1.05M real-world videos to master director-level cinematic planning. WanPE formulates shot-level cinematic plans via video-grounded reverse construction and employs Semantic-Consistency GRPO (SC-GRPO) to faithfully preserve user requirements across shots and over time. To benchmark this capability, we curate WanPEval, a human-annotated testbed covering durations from 5 to 30 seconds across varying intent granularities, supported by approximately 11K blind pairwise assessments. When powering Wan3.0's video generator, WanPE-397B boosts human preference over raw user prompts by 10.66-18.84 points at 5-15 seconds and by a dramatic 50.86 points in the 30-second arena. Ablation studies show that reverse construction demonstrates clear superiority over forward rewriting, while SC-GRPO robustly preserves semantic fidelity across model scales. Ultimately, WanPE leads all evaluated commercial offerings at 5-15 seconds and remains competitive with Seedance 2.5 at 30 seconds.

View source

Similar papers

Preprint Oct 2026

VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generation

An automated evaluation pipeline with human alignments that separately assesses text fidelity through carrier-specific transcription and scene and motion requirements through a prompt-specific chain of query and a Director agent coordinates image and video generation with visual evaluation, guiding iterative refinement...

Yu Huang, Jun-Gang Li, Zhiyuan Wang et al. · 3 citations
Preprint Sep 2026

CinematicVQA: Benchmarking Film-Grammar Reasoning in Large Vision-Language Models

CinematicVQA is introduced, the first-of-its-kind benchmark for cinematic video understanding that goes beyond technique recognition to evaluate film-grammar reasoning, utilizing the introduced Cinematic Scene Graph (CSG), a structured representation that links filming techniques to their perceptual effects and narrati...

Shuo Xing, Pooja Verlani, Balu Adsumilli et al. · 0 citations
#generative ai Review Sep 2026

Reference Fidelity in AI-Generated Short-Form Video Across Four Prompt Packages

Generative video systems can produce short clips from textual and visual instructions, yet their ability to preserve the content of a human reference remains uncertain. This exploratory study examines 160 videos generated with Doubao-Seedance-2.0 from 40 human-made short-form videos drawn from Douyin and Xiaohongshu. T...

Chloe Zihan Jin · 0 citations
Open access Sep 2026

CineScope-Fuse: Cross-Scale Semantic Fusion for Cinematic Aesthetic Assessment of Multimodal-LLM-Generated Videos

Results indicate that cinematic video assessment benefits from jointly modeling low-level fidelity, temporal continuity and high-level narrative alignment, especially for synthetic clips whose visual realism and semantic plausibility fail in different ways.

Yan-Xiu Dan, Yu-Heng Li · 0 citations
Sep 2026

Complementary Retrieval-Augmented Prompting for Consistent Long-Form Video Generation

Quantitative and qualitative evaluations on multi-shot story generation demonstrate that the Complementary Retrieval-Augmented Prompting method consistently outperforms recent-frame, memory-based, and entity-level retrieval baselines in cross-shot consistency and text-controllability.

Xiang-Han Wei, Xiao-Da Yang, Zhi Wang et al. · 0 citations
Preprint Aug 2026

REFRAMED: Towards Realistic Audio Description Generation for Movies

This work introduces a new formulation of AD generation in which models must jointly decide what to describe and when to do it, and presents REFRAMED, a high-quality dataset of 2,023 videos that span 3,302 scenes from 206 movies, with professional AD transcripts, professional subtitles and aligned screenplays.

Igor Sterner, Mirella Lapata, A. Lascarides et al. · 2 citations · ⚡1

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.