On Preference Coverage Collapse from Hindsight Relabeling in Multi-Objective Reinforcement Learning
A natural extension to preference-conditioned multi-objective RL (MORL) relabels transitions with the preference direction the agent achieved rather than the one asked for, and a single-parameter convex combination pulling the achieved direction back towards the requested preference is introduced.
Baptiste Bonin, Caro Strickland, Audrey Durand
· 0 citations