Integrated Policy Gradient is introduced, a novel, training-free framework that brings policy-based attribution into mechanistic interpretability for LLM reasoning and enables modulation of reasoning capabilities, offering a powerful and reliable framework for understanding LLM reasoning.
Chang-Ming Li, Kai-Xin Zhang, Haoyun Xu et al.· 4 citations
Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that affect the physical world. However, current benchmarks largely evaluate LLMs through static text responses, offline tool calls, or simulated tasks, leaving open the questi...
Xin-Nan Dai, Kai-Qi Yang, Ya-Xing Li et al.· 0 citations
Textual skills enable large language model (LLM) based agents to accumulate reusable procedural knowledge without updating model parameters. Yet existing skill evolution remains largely confined to the text space: an optimizer must diagnose success and failure patterns, and revise skills solely from long execution traj...
Kai-Xin Zhang, Chang-Ming Li, Ying-Dong Shi et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.