ORAV Bench for Omni Reference Audio-Video Generation is introduced, comprising 380 task instances with 2-10 references, 9 semantic roles, and 30 role compositions, and a reference-aware pairwise protocol that prepares visual and auditory evidence, compares the intended contribution of each reference, and checks the ove...
Jia-Cheng Hua, Xiao-Kun Feng, Jia-Qi Hua et al.· 0 citations
This framework minimizes maximum mean discrepancy in frozen self-supervised video representation spaces in frozen self-supervised video representation spaces, using a hybrid Nystr\"om--Monte Carlo estimator to balance approximation bias and sampling variance.
Chi Zhang, Yue-Yi Liu, Hao-Yan Shi et al.· 1 citation
InteracVid is introduced, the first open-source large-scale dataset that addresses this missing supervision, so that every sample couples a preceding audio-visual context and an external stimulus with the realinteractive response that follows.
Chi Zhang, Hao-Yan Shi, Yue-Yi Liu et al.· 2 citations
PIVOTS is introduced, the first benchmark built from Social-IQ 2.0 and YouTube data to evaluate MLLMs'ability to predict bidirectional interpersonal relationship dimensions grounded in established psychology research and examines how joint and pairwise prediction settings benefit MLLMs in scoring bidirectional PIVOTS d...
Shuxiang Zhang, Yiting Yin, Wen-Xuan Song et al.· arXiv.org· 0 citations
This work introduces MeetingToM, a benchmark for complex social behavior reasoning in naturalistic multi-party meetings and establishes MeetingToM as a testbed for advancing meeting-grounded ToM in multimodal models.
This paper proposes ElasticTTT, a novel framework that preserves the prior generative distribution and rescues generative elasticity in standard TTT, achieving state-of-the-art performance on one-shot video editing.
Yueyi Liu, Chi Zhang, Sen Cui et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
