Exact Dynamics and Finite-Sample Trajectory Recovery of Linear Recursive Feature Machines
Recursive feature machines (RFMs) learn representations of data by alternating between fitting a predictor to a dataset and updating features of that predictor using the average gradient outer product (AGOP). Connections between AGOPs and feature learning in neural networks motivate linear RFMs as a simple setting for...
Andrew Cheng, B. Kiani, Yue M. Lu et al.
· 0 citations