Real-time omnimodal assistants are expected to support people in everyday life, but audiovisual understanding alone does not establish whether they can provide timely and appropriate help. We introduce Omni-Life, a benchmark grounded in real-world user needs, deployment scenarios, and device-dependent observations. It...
Meng-Ze Hong, Zi-Wei Shang, Di Liang et al.· 0 citations
Evaluating user experience (UX) with automated computational methods has gained increasing attention, supported by empirical evidence from UXBench. However, binary preference prediction provides limited insight, while relying on a single user-agnostic reward model overlooks the inherent heterogeneity of users, whose ex...
Meng-Ze Hong, Zeyang Lei, Wen-Bo Shang et al.· 0 citations
The first user-centric benchmark grounded in real user feedback signals for evaluating preference alignment and dialogue generation is presented, demonstrating that user feedback prediction is a learnable capability and revealing different aspects that influence user experience.
Mengze Hong, Xia Zeng, Zeyang Lei et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.