The Transformer Revolution, Part 1: Dynamic Processing through Output-Weight Interconnections
Biological mechanisms morphologically and functionally correspondent to output-weight interconnections are identified, supporting the in-principle neural realizability of SIDPP and motivating Conjecture T: human neural systems may realize a functional architecture relevantly similar to that of the Transformer.
Marco Giunti, Fabrizia Giulia Garavaglia
· 0 citations