Grafting is proposed, a simple manual intervention that exploits knowledge already encoded in the model to improve AFA performance without requiring ground-truth labels at inference time, and extensive evaluations demonstrate that grafting consistently outperforms direct-prompting approaches.
Wendy Zheng, Liang Wu, Yin-Han He et al.· 0 citations
Safety-aligned large language models often lose their safety behaviors after fine-tuning, even when safety data are included. While this fragility is well documented, its underlying cause remains unclear. In this paper, we propose that formulaic refusal strings can function as outlier modes: narrow, weakly grounded res...
Binchi Zhang, H. Abdullah, Yi-Wei Cai et al.· 0 citations
The proposed AdaST is an adaptive ST forecasting framework that tackles challenges through a decompose-recompose paradigm, and significantly outperforms state-of-the-art baselines, validating the necessity of an adaptive approach.
Teacher Alignment is proposed, which directly adapts the teacher toward the student's distribution without discarding data or degrading reasoning quality, and which significantly outperforms baselines across diverse reasoning benchmarks and distillation methods.
Zhen-Yu Lei, Zi-Han Chen, Yao-Chen Zhu et al.· Conference on Empirical Meth...· 0 citations
This work proposes MemSuit, a self-distillation framework in which a teacher summarizer, conditioned on observed query-answer pairs, produces utility-aware memory entries that a student learns to reproduce from the raw conversation alone, confirming the value of grounding memory in downstream utility.
Zhen-Yu Lei, Ming-Jia Shi, Xing-Bo Fu et al.· Proceedings of the 2026 Conf...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.