Detailed video captioning has become an essential semantic interface for multi-modal understanding and generation. While existing methods mainly target short videos, extending them to long videos remains challenging, primarily due to limited context windows of current video understanding models. A naive solution is to...
Xinlong Chen, Wei-Hong Lin, Yuan-Xing Zhang et al.· 0 citations
Human evaluation confirms that RefCaptioner achieves the best overall performance among the open-source models while remaining competitive on standard video captioning benchmarks, and human evaluation further confirms that its captions are preferred by annotators and enable more source-faithful video reconstruction wit...
Teng-Fei Liu, Yang Shi, Yu-Ran Wang et al.· arXiv.org· 0 citations
This work proposes ReBind, a systematic framework that introduces semantic instructions with embedded reference tokens as the intermediate representation for multi-reference image-conditioned video editing and develops ReBind-Instruct, a specialized MLLM that learns to establish explicit bindings between visual attribu...
Xin-Yu Liu, Shi-Hao Li, Weihong Lin et al.· arXiv.org· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.