Reinforcement learning (RL) for large language model (LLM) agents remains challenging in long-horizon tasks with sparse outcome rewards, where assigning credit to individual actions is difficult. Methods such as GRPO assign the same trajectory-level advantage to all actions, while critic-based methods require learning...
Kai-Jie Zhu, Wei-Xiang Yan, Omar Attia et al.· 0 citations
RLTL;DR is introduced, a promising compacted training paradigm of the form"on this sort of task, keep this sort of thing in mind", which it is hoped will inspire future research on.
Michael Kirchhof, Eleonora Gualdoni, Andrew Szot et al.· 1 citation
Training API-calling large language model (LLM) agents demands massive amounts of high-quality trajectories. However, collecting such data at scale typically requires fully implemented environments with executable APIs and realistic, pre-populated backend databases, creating a major bottleneck for scalability. To overc...