Aligning large language models (LLMs) with human values is important for safe, efficient, and beneficial AI deployment. However, human values are multifaceted: helpfulness, harmlessness and humor trade off against one another, and different users want different trade-offs. Multi-objective alignment (MOA) addresses this...
It is shown that harness-aware post-training not only improves in-distribution performance but also enables agents to robustly adapt to OOD settings, highlighting the importance of harness-aware post-training under such shifts.
Kyungmin Kim, Youngbin Choi, Seoyeon Lee et al.· arXiv.org· 7 citations
Modern large language models (LLMs) operate in interactive multi-turn settings, making multi-turn jailbreaking a realistic threat model and an important setting for automated red teaming. A core challenge in learning multi-turn jailbreak attackers is credit assignment: different turns contribute differently to the fina...
Junyoung Park, N. Park, Sechan Lee et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.