Skip to content

COEVO: Co-Evolving Context and Parameters for Recursive Self-Improvement

Sep 2026 · 1 citation · 30 references
Computer Science

TL;DR

COEVO is introduced, a framework that updates model parameters from on-policy experience while adapting contextual guidance according to the state of the evolving policy, and suggests that external context should be viewed not merely as a fixed interface to a large language model, but as an adaptive component of recursive self-improvement.

Abstract

Recursive self-improvement (RSI) seeks to move large language models beyond static training pipelines toward systems that can participate in improving their own future behavior. Existing approaches largely follow two directions: updating model parameters through online learning, or improving the external context through search, reflection, and prompt optimization. Although both mechanisms can support continued improvement, they are typically studied independently. This separation overlooks an important interaction: the context shapes the experience from which a model learns, while an evolving model may interpret and utilize the same context differently over time. We therefore formulate RSI as a problem of parameter--context co-evolution, where model parameters and the learning context adapt within a shared feedback loop. We introduce COEVO, a framework that updates model parameters from on-policy experience while adapting contextual guidance according to the state of the evolving policy. Policy entropy and prompt-conditioned attention are used as complementary signals to guide this adaptation. Experiments show that COEVO consistently improves task performance over fixed-context reinforcement learning and produces policies that are more robust to changes in system prompts. More broadly, our results suggest that external context should be viewed not merely as a fixed interface to a large language model, but as an adaptive component of recursive self-improvement.

View source

Similar papers

#artificial intelligence Preprint Oct 2026

ImproveAnyTask: An Autonomous Post-Training Harness for Iterative Model Self-Improvement

Adapting general-purpose large language models to specific tasks requires substantial human effort in designing data and training strategies. Sustaining improvement is especially challenging because model updates change the error distribution, requiring strategies to be continually refined. We introduce ImproveAnyTask,...

Xing-Bo Yao, Xiao-Man Wang, Zheng-Wu Lei et al. · 2 citations

When Updating Stops Being Learning: Rethinking LLM Self-Evolution via learnable information gain

A holistic framework based on learnable information gain, which measures how much novel, parameterizable information a round provides relative to the previous round, and proposes ATRI (Adaptive Training Regulation via Information-gain), which reweights samples within a round and halts training across rounds when inform...

Chen-Xu Wang, Chao-Zhuo Li, Xin-Ze Shi et al. · 0 citations

TTSE: A Two-Track Online Self-Evolution Framework

This paper proposes TTSE (Two-Track Self-Evolution), a dual-track online self-evolution framework that separates evolving knowledge into FACT (environmental facts, whose reliability is continuously verified through interaction evidence) and TIP (task-conditioned implementation procedures), and broadly compatible with e...

Rui-Min Pei, Yong-Kang Wu, Shang-Yi Zheng et al. · 1 citation

Towards Evolving Context Parameterization for Large Language Models

This work proposed PLUME, a training-free method that constructs a global update representation, activates memory evidence to form a local parameter view, and adaptively integrates their predictions during decoding, which demonstrated its effectiveness in sequential evolution settings.

Xiao Shi, Zhe-Rui Li, Yi-Ming Jiang et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.