Autonomous agents powered by foundation models can reason, plan, and use tools, but their fixed weights and context limits hinder sustained learning from experience over long-term deployment. While external memory systems attempt to bridge this gap, they mostly act as passive retrieval caches, evaluated primarily by wh...
Dongfang Li, Zhuo-En Chen, Bo-Nian Jia et al.· 0 citations
Discrete Diffusion Models (DDMs) have recently emerged as a promising paradigm for text generation, providing an alternative to the dominant autoregressive (AR) approach. Unlike AR models that rely on sequential decoding and suffer from exposure bias, DDMs operate in discrete token space through iterative denoising, en...
Yi-Xuan Li, Kai-Dong Yu, Shuang-Yong Song et al.· Vicinagearth· 0 citations
Quality-Gated Length Advantage Shaping (QGLAS), which first computes advantages from quality rewards alone, then adds bounded bonuses only to shorter positive-advantage responses, leaving all other advantages unchanged, consistently achieves a stronger quality--length trade-off than representative baselines.
Zi-Jun Weng, Zhong-An Bi, Xuan-Ang Gao et al.· 0 citations
Dual Attention Residuals (DAR) is proposed, which brings multi-stream interaction into historical retrieval through reciprocal cross-stream addressing and consistently improves validation loss over standard residual Transformers and Attention Residuals.
Xing-Da Yu, Yi-Ning Li, Xin-Zhang Liu et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.