Hidden Activations are not Enough I: Knowledge Matrices as Higher Representations
The knowledge matrix of a trained feedforward network as a higher representation of its inputs is studied, grounding it in attribution theory and computing it by $C$ vector-Jacobian products instead of probing.
Marco Armenta
· 0 citations