This work introduces a multi-level evaluation built on existing, verifiable tasks, and shows why ToM evaluation must connect perspective inference to independently verified decisions and task consequences.
Zhen-Shuai Yin, Yong-Xin Guo, Ming-Da Zhang et al.· 0 citations
Knowing when they are reliable is essential for language models to support human-AI collaboration. Yet interaction feedback is not always complete or correct, and may mislead models'understanding of their own capabilities. We introduce LADDER to study how language models assess themselves under unreliable feedback. Our...
Zhen-Shuai Yin, Jian-Shuai Liang, Xu-Yue Xiong et al.· 0 citations
On-policy distillation (OPD) improves a student language model by training on its own generated trajectories with supervision from a stronger teacher. However, when conditioned on student-generated prefixes, the teacher can favor invalid continuations that violate the question's premises, causing OPD to encourage erron...
Wen-Xuan Luo, Chen-Xi Li, Hao-Yue Liu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.