Trajectory-Relative Hindsight Distillation for Agentic Reinforcement Learning
Experiments on WebShop and ALFWorld with different backbones show that TRIAL outperforms GRPO across all eight combinations of backbone, environment, and evaluation metric, while achieving the best or tied-best performance among six methods on six of them.