This work characterize OPD across nine student-teacher pairs spanning 2x to 53x parameter ratios and shows that OPD effectiveness depends on student-teacher compatibility rather than teacher scale alone, and suggests that each post-training stage should be chosen not only for the capability it adds, but for the learnin...
Emre Can Acikgoz, Yang Li, Z. Liu et al.· 0 citations
Just-in-Time Memory (JitMem) consistently outperforms no-memory agents as well as heuristic and learned write-time memory methods, improving over the strongest baseline by 16.2, 16.3, and 3.9 absolute success-rate points, respectively.
The results suggest that dense credit assignment through distillation can be effective when its likelihood-based scores are empirically validated as meaningful proxies for outcome-relevant credit, when this alignment does not hold.
Xuan-Phi Nguyen, Z. Liu, Yang Li et al.· 3 citations
It is found that simply training models on CoT data of atomic tasks leads to limited generalization, but minimally modifying CoT formats of constituent atomic tasks to be composable can lead to improvements.
Fangcong Yin, Zeyu Liu, Liu Leqi et al.· arXiv.org· 1 citation
TaxEL introduces Taxonomy-Guided Contrastive Sampling (TGCS), which systematically integrates both local ontology structure and global semantic similarity to generate informative positive and hard negative samples for each mention; and Structured Semantic Alignment Loss (SSAL), which enforces alignment between model pr...
Rui Hua, Zeyu Liu, Zixin Shu et al.· IEEE journal of biomedical a...· 0 citations
Procedural Memory Distillation is proposed, which converts crossepisode signals into reusable procedural memory and distills it into the policy's weights during training, yielding a memory-free model at inference.
Ye Liu, Srijan Bansal, Bo Pang et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.