Shun-Shi Zhang

When Updating Stops Being Learning: Rethinking LLM Self-Evolution via learnable information gain

A holistic framework based on learnable information gain, which measures how much novel, parameterizable information a round provides relative to the previous round, and proposes ATRI (Adaptive Training Regulation via Information-gain), which reweights samples within a round and halts training across rounds when inform...