Tracing distinguishability through transformer processing with stochastic LayerNorm
Representational similarity is foundational to analyses of deep networks, yet distances between point-valued representations are not intrinsically tied to downstream function: nearby states may produce different behaviors, while distant states may behave similarly. We instead give representations volume, turning simila...
Kieran A. Murphy
· 0 citations