This work revisits the forgetting target of LLM unlearning and introduces Knowledge Association (KA), which characterizes the association between a query context and its target knowledge and is instantiated by the corresponding conditional predictive distribution, as the fundamental target of forgetting.
Wu-Tong Xu, Yun Qu, Hai-Yan Feng et al.· 0 citations
TreeOPSD is introduced, a critic-free, tree-aware posterior self-distillation framework for long-horizon agentic reinforcement learning that improves agentic capabilities across several competitive benchmarks and model scales, especially for long-horizon tasks.
Heming Zou, Qi Wang, Yi-Xiu Mao et al.· 2 citations
In-context learning (ICL) is crucial for boosting the inference performance of large language models (LLMs). However, the effectiveness of ICL in LLMs is greatly influenced by the choice of demonstration sets. Exhaustive searches over these sets are combinatorial, and existing selectors often rely on relevance or likel...