Continual learning (CL) is essential for Large Language Models (LLMs) to sequentially adapt to evolving tasks. To mitigate catastrophic forgetting, recent advances implement low-rank adaptation with orthogonal projections (e.g., O-LoRA) to isolate task parameters. However, we reveal that such strict geometric constrain...
Mao-Qi Liu, Quan Fang, Yu-Fei He· Proceedings of the 2026 Conf...· 1 citation
This work introduces Trajectory-to-Step Policy Optimization (T2SPO), a method that uses past interaction trajectories to provide step-level feedback for policy learning and shows that T2SPO consistently improves overall task success over GRPO.
Bo-Wen Zhang, Jun-Wei He, Mao-Qi Liu et al.· 1 citation
Rubric-based reinforcement learning (Rubric-RL) trains language models where no verifier exists. A judge checks each criterion of a rubric, and the verdicts are aggregated into a reward, most often by a weighted sum. We show that this additive aggregation is the weak point. Under a sum, criteria compensate for one anot...
Mao-Qi Liu, Jun-Wei He, Bo-Wen Zhang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.