Jian-Hua Z. Huang

When Does Backpropagating Through Policy Memory Matter? Physical Credit, Optimizer Updates, and Observability

M measuring the cost of a memory cut by training with it from initialization, and comparing backward graphs by the updates the optimizer applies rather than by raw gradients suggest the cost of a memory cut should be measured by training with it from initialization.