Human evaluation confirms that RefCaptioner achieves the best overall performance among the open-source models while remaining competitive on standard video captioning benchmarks, and human evaluation further confirms that its captions are preferred by annotators and enable more source-faithful video reconstruction wit...
Teng-Fei Liu, Yang Shi, Yu-Ran Wang et al.· arXiv.org· 0 citations
MultiRef-Compass is introduced, a unified benchmark for MR2AV generation that integrates automatic metrics with a rejudging-enhanced MLLM-as-a-Judge framework, enabling scalable and auditable evaluation of both perceptual fidelity and reference-conditioned composition.
AVE-Agent is proposed, a modular agent framework that decomposes complex instructions into dependent subtasks and iteratively improves editing results through self-reflection and evaluator feedback, and improves instruction execution, Fidelity Preserving, and audio-visual alignment in joint editing while maintaining co...