Speed Limit for Information Acquisition in Stochastic Learning Dynamics
A Fisher-information flow speed limit is derived that bounds the rate at which trainable parameters can acquire information about latent variables in the data-generating process and establishes Fisher-information speed limits as a quantitative framework for diagnosing when and how different aspects of the data-generati...
Shuta Kobayashi, Andreas Dechant
· 0 citations