It is shown that meta-learning can substantially reduce or entirely eliminate performance differences across architectures and data representations, suggesting that these factors may be less important as sources of inductive bias than is typically assumed.
Uc Merced, Gianluca M. Bencomo, Max Gupta et al.· 0 citations
The results show that models’ verb representations degrade more when the authors perturb word order, which removes syntactic information, than when they perturb co-occurrence among content words, which removes semantic information.
Xiao-Meng Zhu, R. Thomas McCoy, Robert Frank· Open Mind· 0 citations
It is shown that the vector representations of a variety of neural networks can be closely approximated with symbolic structures, providing a potential way to reconcile longstanding symbolic conceptions of intelligence with the vector-based nature of modern AI.
R. Thomas McCoy, Paul Soulos, Tal Linzen et al.· 2 citations
This work proposes using Tensor Product Representations (TPRs) as a unifying hypothesis, and shows that TPRs can unify several prior interpretability methods: additive analogies, linear probing, sparse autoencoders, and activation patching.
Enshang Zhang, R. Thomas McCoy· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.