Multimodal large language models (MLLMs) can generate detailed video captions, yet they may overemphasize minor details while overlooking essential context and key events. We argue that not all visual evidence deserves equal attention, as the importance of visual information depends on the content of each video. Motiva...
Teng-Fei Liu, Yang Shi, Yu-Ran Wang et al.· 0 citations
The Thinking Reward Model (TRM), a paradigm that explicitly determines what matters for each case before judging how well the candidate performs, is proposed, which formulates case-adaptive rubrics, performs rubric-guided assessment, and produces fine-grained pointwise rewards.
Xue-Yuan Bai, Zhen-Chen Tang, Yang Shi et al.· 0 citations
This work introduces HiRAE (Hierarchical Representation Autoencoder), which learns a hierarchical fusion framework over the full encoder hierarchy to improve reconstruction fidelity while maintaining compatibility with generative modeling.
Xuan-Yu Zhu, Yan Bai, Yang Shi et al.· arXiv.org· 0 citations
Human evaluation confirms that RefCaptioner achieves the best overall performance among the open-source models while remaining competitive on standard video captioning benchmarks, and human evaluation further confirms that its captions are preferred by annotators and enable more source-faithful video reconstruction wit...
Teng-Fei Liu, Yang Shi, Yu-Ran Wang et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.