Feature Information Dynamics in Diffusion
Diffusion models generate data through a continuum of denoising problems, and are widely observed to reveal coarse structure before fine detail. Yet, this intuition is mostly empirical and qualitative. We introduce feature information dynamics, an information-theoretic framework for localizing when a feature is generat...
Jia-Shu Pan, Tao Zhang, Yu-Fei Huang et al.
· 0 citations