Skip to content

Reference Fidelity in AI-Generated Short-Form Video Across Four Prompt Packages

Sep 2026 · Communications in Humanities Research · 0 citations

Abstract

Generative video systems can produce short clips from textual and visual instructions, yet their ability to preserve the content of a human reference remains uncertain. This exploratory study examines 160 videos generated with Doubao-Seedance-2.0 from 40 human-made short-form videos drawn from Douyin and Xiaohongshu. The references were divided evenly among humor, informational, demonstration, and storytelling content. Qwen3.8-Max analyzed each reference and produced four prompt packages labeled vague, vivid, keyword, and image-based. The fourth package also contained timestamped reference frames, frame descriptions, identity constraints, and sequence instructions, so it is treated as a multimodal reference condition rather than a pure image condition. Each prompt was used once under the same default settings, and no output was edited after generation. Metadata inspection covered the complete corpus. All 40 groups received a standardized frame review, and eight groups were examined at three temporal positions. Outputs usually retained the source topic and central action. Fidelity was stronger for one-subject situations than for multi-step procedures, factual labels, comic timing, or longer causal sequences. The multimodal package appeared closer to source composition in several cases, yet the one-shot design and unequal prompt information prevent a causal ranking. The study therefore evaluates reference fidelity rather than virality or prompt efficacy.

View source

Similar papers

Preprint Sep 2026

Complementary Retrieval-Augmented Prompting for Consistent Long-Form Video Generation

While recent video foundation models excel at generating high-quality short videos, long-form video generation remains a critical challenge, where a major bottleneck lies in conditioning independently generated shots to preserve consistent characters, scenes, and objects throughout a story. Existing training-free appro...

Xiang-Han Wei, Xiao-Da Yang, Zhi Wang et al. · 0 citations
Preprint Oct 2026

Towards Unified Evaluation of Prompt Enhancers for Video Generation

Modern video generators can realize increasingly complex visual narratives, positioning the prompt enhancer (PE) as a critical bridge from concise user instructions and multimodal references to structured cinematic plans. However, existing PE evaluation relies on rendered videos, imposing substantial computational and...

Ya-Wen Shao, Yu-Bo Zhu, Zi-Yun Dai et al. · 0 citations
Preprint Sep 2026

WanPE: Towards Cinematic Prompt Enhancement for Modern Text-to-Video Generation

WanPE formulates shot-level cinematic plans via video-grounded reverse construction and employs Semantic-Consistency GRPO (SC-GRPO) to faithfully preserve user requirements across shots and over time, leading all evaluated commercial offerings at 5-15 seconds and remains competitive with Seedance 2.5 at 30 seconds.

Yu-Bo Zhu, Ya-Wen Shao, Zi-Yun Dai et al. · 1 citation
Preprint Sep 2026

ORAV: Benchmarking Audio-Video Generation from Multimodal Contexts

ORAV Bench for Omni Reference Audio-Video Generation is introduced, comprising 380 task instances with 2-10 references, 9 semantic roles, and 30 role compositions, and a reference-aware pairwise protocol that prepares visual and auditory evidence, compares the intended contribution of each reference, and checks the ove...

Jia-Cheng Hua, Xiao-Kun Feng, Jia-Qi Hua et al. · 0 citations
Preprint Sep 2026

MSR: Multiple Subject Reference for Video Generation

MSR (Multiple Subject Reference), a slot-aware conditioning scheme for LTX-based video generation, is presented and development observations suggest reduced reference confusion relative to an earlier continuous-reference baseline.

Guan-Nan Li, Jia-Ji Chen, Jing-Yuan Liao et al. · 0 citations

DRS Digital Library

Danyal Sarfraz, Raja Mubashar Karim, KwanMyung Kim · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.