Language models can answer a question from a supplied document or from their parametric knowledge. When later asked where the answer came from, what determines their source report? We study this by intervening on the model's key-value (KV) cache after the answer is generated and before the source question is asked. On...
Kirill Afendulev, Alexey Dontsov, Alla Chepurova et al.· 0 citations
Mechanistic interpretability aims to decompose neural network computations into human-understandable features, yet progress is limited by the absence of ground-truth units to evaluate against. We address this with a Sparse Transformer (ST): a 5-layer language model trained on TinyStories whose wide, TopK-sparse MLP for...
Anton Korznikov, Alexey Dontsov, Elena Tutubalina· 0 citations
Language models can now prove theorems, but people still decide which problems to pursue. We ask whether a model's internal representations can help identify promising mathematical connections. We develop LANTERN, a fast, cost-efficient pipeline that uses a classifier over pretrained-model activations to rank candidate...
Pavel Tikhonov, Elena Tutubalina, I. Oseledets et al.· arXiv.org· 0 citations
Two cache-level interventions are introduced: Split-prefill keeps only the KV cache or only the recurrent state from a prefilled context, then generates an answer, and state-swap pairs the KV cache from one context with the recurrent state from another in a single forward pass.
Kirill Afendulev, Alexey Dontsov, Elena Tutubalina et al.· 2 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.