This work proposes Many-Tier Instruction Hierarchy (ManyIH), a paradigm for resolving instruction conflicts among instructions with arbitrarily many privilege levels, and introduces ManyIH-Bench, the first benchmark for ManyIH.
Jing-Yu Zhang, Tian-Jian Li, William Jurayj et al.· arXiv.org· 9 citations
Token-Aware Phase Attention (TAPA) is introduced, a new positional encoding method that incorporates a learnable phase function into the attention mechanism and attains substantially lower perplexity and stronger retrieval performance in the long-context regime than RoPE-style baselines.
RECAP (Robust Safety Alignment via Counter-Aligned Prefilling), a principled reinforcement learning (RL) method for post-training that explicitly teaches models to override flawed reasoning trajectories and reroute to safe and helpful responses, substantially improves safety and jailbreak robustness, reduces overrefusa...
Sheng-Hsuan Peng, E. Smith, Ivan Evtimov et al.· arXiv.org· 10 citations· ⚡2
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.