Integrated Policy Gradient is introduced, a novel, training-free framework that brings policy-based attribution into mechanistic interpretability for LLM reasoning and enables modulation of reasoning capabilities, offering a powerful and reliable framework for understanding LLM reasoning.
Chang-Ming Li, Kai-Xin Zhang, Haoyun Xu et al.· 4 citations
On-policy distillation (OPD) improves language-model by supervising a student on prefixes sampled from its own policy, but its supervision remains confined to the output space. Consequently, OPD transfers what a teacher predicts without supervising the intermediate computation that produces those predictions. Simply di...
Ying-Dong Shi, Zhi-Hong Li, Chang-Ming Li et al.· 1 citation
Textual skills enable large language model (LLM) based agents to accumulate reusable procedural knowledge without updating model parameters. Yet existing skill evolution remains largely confined to the text space: an optimizer must diagnose success and failure patterns, and revise skills solely from long execution traj...
Kai-Xin Zhang, Chang-Ming Li, Ying-Dong Shi et al.· arXiv.org· 0 citations
This work proposes DesignAsCode, a novel framework that reimagines graphic design as a programmatic synthesis task using HTML/CSS, incorporating a Plan-Implement-Reflect pipeline, incorporating a Semantic Planner to construct dynamic, variable-depth element hierarchies and a Visual-Aware Reflection mechanism that optim...