We have 3 of 7 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
The results suggest that temporal thinking offers a parameter-efficient alternative to increasing physical depth in recurrent Transformers, and that temporal thinking offers a parameter-efficient alternative to increasing physical depth in recurrent Transformers.
Latent Recurrent Transformer is studied, a lightweight augmentation of autoregressive transformers that reuses a high-level source-layer hidden state from the previous token as recurrent memory for the next token, while retaining one-forward-per-token decoding with 9% latency overhead over the standard Transformer.
The TaSe (Talk in Pieces, See in Whole) framework is introduced with three main contributions: a hierarchical synthetic captioning dataset spanning three tiers from category names to descriptive sentences; the three-component disentanglement module guided by a novel disentanglement loss function, transforms text embedd...
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
