Context Language Models
Context Language Models are introduced, language models that natively manage their own context and can be steered with natural-language instructions evolved through a standard skill-optimization loop, improving held-out accuracy by up to 35.9 points on a context-management task while reducing compute.
Ru-Lin Shao, Shannon Zejiang Shen, J. Yin et al.
· 0 citations