This work isolates the source of the loss, finding that the positional mismatch has minor effect, and independently cached artifacts retain faithful representations: reading a provided artifact stays largely accurate, and performance degrades only when the model must select among multiple artifacts.
Xing-Hao Chen, Jun-Nan Dong, Cai Ke et al.· 1 citation· ⚡1
Large language model (LLM) agents repeatedly load reusable content, such as skills, documents, and memory entries, into the current context. Re-encoding this content for every request wastes computation. Position-independent caching (PIC) alleviates this by encoding each artifact independently and reusing its key-value...
Xing-Hao Chen, Jun-Nan Dong, Cai Ke et al.· arXiv.org· 0 citations
LGM is presented, a novel neuro-symbolic framework that shifts long-term memory disentanglement into a continuous latent space and significantly outperforms state-of-the-art baselines in capturing both explicit and implicit preferences while enabling personalized responses.
Cai Ke, Xing-Hao Chen, Xiao-Yu Shen et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.