Reasoning-Induced Misalignment, where fine-tuning on reasoning data containing no harmful content, including mathematics, code, and problem-solving with chain-of-thought traces can induce harmful behaviors of LLM, posing a serious challenge to the safety of LLM reasoning. Cross-architecture, cross-scale, and cross-data...
Yipeng Zhao, Qi-Shun Yang, Shenzhe Zhu et al.· 0 citations
SFAD is presented, a speculative decoding framework that enhances contextual faithfulness without inference degradation and substantially improves faithfulness while achieving $2.48\times$ speedup, offering a practical solution for efficient LLMs.
These results show that evaluating only a final checkpoint can obscure both when counterfactual responsiveness changes and what the latent states contribute, and show that high task accuracy can coexist with low counterfactual responsiveness.
Heng-Yu Jin, Shu Yang, Di Wang· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.