Summary-token architectures such as Kwai Summary Attention (KSA) compress distant context into learnable Summary token per chunk, and hybrid variants interleave these layers with full attention to retain exact access to the original text. In such hybrid KSA-Full architecture, the interleaving inserted summary tokens ar...
OneRec Team, Chenglong Chu, Guo-Hong Mu et al.· 0 citations
A series of models are explored that connect item Semantic IDs with natural language in a unified representation space and seek to unlock the potential of natural-language chain-of-thought (CoT) reasoning for recommendation, including OneReason.
The proposed Uncertainty-Calibrated MOPD (UCMOPD), which addresses limitations of standard MOPD through two complementary mechanisms, improves the general-capability average over standard MOPD by $4.48\% and $7.86\% while maintaining vertical-domain performance.
Zi-Yuan Liu, Jiao Ou, Jian Liang et al.· 0 citations
Counteraction-Aware Multi-Teacher On-Policy Distillation is proposed, which addresses issues with decoupled alternating training and gap-based sample selection and outperforms all baselines in general capability recovery while maintaining domain-specific behavior.
Tian-Le Chen, Jiao Ou, Zi-Yuan Liu et al.· arXiv.org· 13 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.