Autonomous agents powered by foundation models can reason, plan, and use tools, but their fixed weights and context limits hinder sustained learning from experience over long-term deployment. While external memory systems attempt to bridge this gap, they mostly act as passive retrieval caches, evaluated primarily by wh...
Dongfang Li, Zhuo-En Chen, Bo-Nian Jia et al.· 0 citations
Quality-Gated Length Advantage Shaping (QGLAS), which first computes advantages from quality rewards alone, then adds bounded bonuses only to shorter positive-advantage responses, leaving all other advantages unchanged, consistently achieves a stronger quality--length trade-off than representative baselines.
Zi-Jun Weng, Zhong-An Bi, Xuan-Ang Gao et al.· 0 citations
Results show that selective anti-interference is an effective objective-level signal for robust context use and identifies locally sufficient tokens and sharply reduces prefix sensitivity on gate-selected suffix tokens.
Jin-Chang Zhu, Hao-Lan He, Yi-Cheng Ding et al.· 0 citations
Dual Attention Residuals (DAR) is proposed, which brings multi-stream interaction into historical retrieval through reciprocal cross-stream addressing and consistently improves validation loss over standard residual Transformers and Attention Residuals.
Xing-Da Yu, Yi-Ning Li, Xin-Zhang Liu et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.