Preprint
Oct 2026
Cache2LoRA: Understanding and Improving Context Internalization
Context-to-LoRA methods encode documents as low-rank parameter updates, allowing language models to answer without retaining the source text in their decoding context. How reliably do these updates preserve facts and support their use under different instructions? Controlled diagnosis of existing context-to-LoRA method...
Yi Fang, Gaurav Srivastava, Zhenyu Bi et al.
· 0 citations