On the Feature Evolution of Temporal Difference Learning
Temporal-difference (TD) learning trains neural representations using bootstrapped targets generated by evolving value estimates, yet how predictive features emerge and propagate under incomplete neural updates remains poorly understood. We investigate this problem using finite-width two-layer ReLU critics on a constru...
Shang-Zhe Li, De-Chen Zhang, Di-Fan Zou et al.
· 0 citations