Evaluating human-AI co-design requires testing whether coding agents can translate real users'multimodal requests into working application revisions. We introduce Co-Design Bench, a reference-free benchmark of 273 tasks curated from 37,463 deduplicated queries across 26,314 real user coding sessions. Its two tracks, Mu...
Xi-Lin Wei, Sheng-Yuan Ding, Xinyu Fang et al.· 0 citations
V-ICAL is introduced, a novel benchmark designed to evaluate video-based ICL for multimodal agents that seamlessly connects in-context knowledge induction with core agentic capabilities, including state grounding, temporal memory, planning, and adaptation in dynamic environments.
Zi-Qian Fan, Shi-Bo Xu, Jun-Jie Li et al.· 0 citations
This work presents WorldReward, a VLM-based pairwise preference reward model that unifies action-consistency and visual-quality evaluation for camera-conditioned world models, and introduces WorldReward-Bench, a human-annotated benchmark measuring reward-model agreement with human preferences across action consistency,...
Yi-Bin Wang, Ze-Han Wang, Junshu Tang et al.· 0 citations
This work proposes Hybrid-Policy Self-Distillation (HPSD), a novel self-distillation framework where a single TI2V model acts as both teacher and student under different conditions: the teacher operates in TI2V mode with a high-quality first frame and an enhanced prompt, while the student runs in the base T2V mode with...
Jia-Zi Bu, Peng-Yang Ling, Yu-Jie Zhou et al.· 2 citations
Evaluations across scientific, multimodal, agentic, and general-purpose benchmarks show that Intern-S2-Preview-397B achieves competitive or leading results in multiple settings.
Lei Bai, Jiaqi Cao, Chiyu Chen et al.· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.