Agentic In-Context Learning: What Algorithms Can Transformers Learn in Closed-Loop Interaction?
The learning algorithm view of in-context learning (ICL) studies how fixed-parameter Transformers learn from supplied examples. Language model agents extend this setting through interaction: their actions determine what evidence enters context next. We call this regime Agentic In-Context Learning (Agentic ICL). Existin...