Shuta Kobayashi

Speed Limit for Information Acquisition in Stochastic Learning Dynamics

A Fisher-information flow speed limit is derived that bounds the rate at which trainable parameters can acquire information about latent variables in the data-generating process and establishes Fisher-information speed limits as a quantitative framework for diagnosing when and how different aspects of the data-generati...