Fengyu Cao

Time-Inconsistent MDPs with Entropy Regularization: Equilibrium Existence and Policy Iteration

Combining the policy-iteration error with a quantitative soft-max approximation bound, it is shown that the iterated policies constitute weighted $\varepsilon$-equilibria for the original unregularized problem and derive an explicit regret estimate.