It is found that compression degrades reliability before solvability and proposed PAIR (Prompt Adaptation using Interventional Rollouts) for adapting structured compression prompts achieves the strongest cross-run reliability among compressed methods in every main benchmark-scope combination.
Guang-Hui Min, Liang Wu, Ming-Jia Shi et al.· 0 citations
This work proposes MemSuit, a self-distillation framework in which a teacher summarizer, conditioned on observed query-answer pairs, produces utility-aware memory entries that a student learns to reproduce from the raw conversation alone, confirming the value of grounding memory in downstream utility.
Zhen-Yu Lei, Ming-Jia Shi, Xing-Bo Fu et al.· 0 citations
This work systematically characterize the implicit biases introduced by low-rank adaptation during alignment and establishes two theorems showing that low-rank alignment induces preferences for parameter subspaces with flat gradients and feature subspaces robust to perturbations, providing a principled explanation for...
Mingjia Shi, Shuo Wang, Xiaobo Wang et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.