Machine unlearning for large language models seeks to remove specified knowledge while preserving general capability, yet current methods often treat an entire response as the unit of forgetting. This coarse granularity causes unnecessary utility loss when the forget target is only a small set of sensitive facts embedd...
Jing-Yue Cong, Anyang Song, Yang Yu et al.· 0 citations
Large language models (LLMs) are expected to answer questions faithfully based on the provided context, abstaining when the context information is insufficient to answer the questions. Existing faithfulness evaluations typically assess each question-context instance in isolation; however, such instance-level evaluation...
Zi-Zhuo Zhang, Xiong Peng, Jing-Wei Sun et al.· 0 citations
Multi-agent LLM systems pair a sender with broad context and an executor with a limited local view. We study when a short message improves the executor's next decision, when raw context is preferable, and when a stronger sender helps. Our framework, \emph{receiver-relative bounded coordination}, expresses message utili...
Yi Xie, Zhan-Ke Zhou, Yi-Sheng Fan et al.· 0 citations
Reliable large language models (LLMs) must not only produce accurate answers but also express confidence that faithfully reflects their probability of being correct. Such calibration is essential for identifying uncertain predictions and supporting reliable decision-making in real-world deployment. Recent studies incor...
Zi-Zhuo Zhang, Xiong Peng, Jing-Wei Sun et al.· 0 citations
This work proposes Targeted Anti-obfuscation with Mechanistic Enforcement (TAME), which uses Sparse Autoencoders (SAEs) to combine behavioral feedback with targeted suppression of template-associated activations during RL, providing a path from behavioral monitoring to representation-level oversight for more auditable...
Xu-Tao Mao, Jianing Zhu, Jin-Man Zhao et al.· 0 citations
DE-Venus is presented, a unified framework for data-efficient RLVR that treats supervision as evolving state across data preparation and policy optimization and reduces annotation and training costs without sacrificing scalable RL execution.
Shen-Zhi Yang, Guang-Cheng Zhu, Kai Tang et al.· 0 citations
This analysis provides a structured account of current approaches to scaling LRMs beyond human supervision and the open problems involved in developing self-sustaining learning systems toward superintelligence.
Zhiqin Yang, Jing-Wen Fu, Yu-Han Liu et al.· 4 citations
It is observed that OPD-trained models maintain superior avg@K performance across sampling budgets, while the advantage in pass@K gradually shifts to the pre-OPD base models as K increases, suggesting that OPD primarily improves sampling efficiency rather than consistently expanding the student's reasoning capability b...