RELACE: retrospective likelihood-based action credit estimation for long-horizon language agents
This work introduces RELACE, Retrospective Likelihood-based Action, a critic-free framework that integrates retrospective action assessment with state-conditioned advantage estimation, and uses this factor to reweight discounted task returns and construct local advantages by comparing weighted returns among actions fro...