Skip to content
Preprint

VI-Bench: Benchmarking Prompt Inversion from AIGC Videos

Sep 2026 · 0 citations · 32 references
Computer Science

TL;DR

VI-Bench shows that video prompt inversion is a distinct and under-evaluated capability requiring models to transform visual understanding into replay-stable generative control, and evaluates 18 representative VLMs on this benchmark.

Abstract

Recent advances in video generation have made prompt-based control increasingly central to AIGC video generation. Prompts specify what a video should depict and how it should be represented, controlling factors such as visual style or camera behavior. Understanding this recoverability is important both for creative reuse and editing, and for assessing prompt leakage risks. However, existing video understanding benchmarks do not measure this capability: a caption may describe what is visible, but a replayable prompt must recover the generation-relevant controls needed to reproduce the video. To address this gap, we introduce VI-Bench, a benchmark built from 16.1 million real-user prompts and 900 human-verified AIGC videos. VI-Bench spans three progressively harder settings, namely single-shot semantic grounding, control over style and camera behavior, and multi-shot compositional inversion, and evaluates five generation-critical dimensions: subject, action, scene, style, and camera. We evaluate 18 representative VLMs, including 2 proprietary and 16 open-source models on VI-Bench, using an Inversion Score that measures prompt-level alignment with the original prompt and video-level fidelity of the regenerated video. The results reveal substantial limitations: even the strongest model achieves only 0.632 on Inversion Score, performance degrades sharply as samples require richer control and multi-shot reasoning, and models often produce plausible prompts whose regenerated videos deviate from the reference. These findings show that video prompt inversion is a distinct and under-evaluated capability requiring models to transform visual understanding into replay-stable generative control.

View source

Similar papers

Preprint Aug 2026

VGI-Bench: Probing Visual Intelligence in Video Generation Models

VGI-bench is introduced, containing 27 tasks and 810 instances, organized by a two-level taxonomy of task domains and skill tags for fine-grained evaluation of visual reasoning capabilities of video generation models, and it is hoped VGI-bench will help stimulate the development of next-generation video generation mode...

Xuan He, Cong Wei, Yuhao Cheng et al. · 3 citations
#artificial intelligence Conference Sep 2026

From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models

This work proposes Vid-PRE (Video Prompt Reasoner and Enhancer), a model-agnostic prompt rewriter that offloads the cognitive burden of reasoning to a dedicated VLM, and introduces VWG-Bench, a comprehensive benchmark spanning 9 reasoning dimensions and 38 fine-grained tasks.

Meng Luo, Yi-Chen Liu, Jia-Hao Wang et al. · 1 citation
Preprint Oct 2026

VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generation

An automated evaluation pipeline with human alignments that separately assesses text fidelity through carrier-specific transcription and scene and motion requirements through a prompt-specific chain of query and a Director agent coordinates image and video generation with visual evaluation, guiding iterative refinement...

Yu Huang, Jun-Gang Li, Zhiyuan Wang et al. · 3 citations
Preprint Aug 2026

VideoVIBE: A Video-Grounded Diagnostic Benchmark for One-Shot Interactive Website Generation

VideoVIBE is introduced, a video-grounded benchmark that transforms human-operated webpage recordings into fine-grained diagnostic tasks and V2Lens is proposed, a training-free, evidence-grounded multi-agent system that challenges and selectively refines initial video-based diagnoses through targeted visual and source-...

Jia-Jun Xu, Yang-Hao Zhou, Jing Liao et al. · 1 citation
Preprint Aug 2026

Dancing Stick Figures: An Introductory Dataset for Training Video Generation Models

Training a video-generation model from scratch is hard for reasons that precede model design. The feedback loop is long: a failure that appears only after a training run can make each attempted fix another run. The data are hard to reach: the corpora and recipes behind strong models are large, heterogeneous, and often...

Jinhee Cho · 0 citations
#artificial intelligence Preprint Sep 2026

VidOmni-Bench: A Benchmark for Fine-Grained Video Understanding via Spatio-Temporal Event Verification across Complexity and Duration

VidOmni-Bench is introduced, a benchmark that requires models to verify whether each event in dense video captions is supported by the video, and reveals three key findings: Video-LLMs frequently generate hallucinated descriptions in dense video captioning, and they also struggle as verifiers.

Changbeen Kim, Jun-Qing Chang, Kipyo Kim et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.