Skip to content

Author

Elena Tutubalina

We have 4 of 24 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Context or Knowledge: How LLMs Attribute Their Own Answers

Language models can answer a question from a supplied document or from their parametric knowledge. When later asked where the answer came from, what determines their source report? We study this by intervening on the model's key-value (KV) cache after the answer is generated and before the source question is asked. On...

Kirill Afendulev, Alexey Dontsov, Alla Chepurova et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Sparse Transformer: a Controlled Testbed for Mechanistic Interpretability

Mechanistic interpretability aims to decompose neural network computations into human-understandable features, yet progress is limited by the absence of ground-truth units to evaluate against. We address this with a Sparse Transformer (ST): a 5-layer language model trained on TinyStories whose wide, TopK-sparse MLP for...

Anton Korznikov, Alexey Dontsov, Elena Tutubalina · 0 citations

LANTERN: Illuminating Hidden Mathematical Knowledge in Language Models

Language models can now prove theorems, but people still decide which problems to pursue. We ask whether a model's internal representations can help identify promising mathematical connections. We develop LANTERN, a fast, cost-efficient pipeline that uses a classifier over pretrained-model activations to rank candidate...

Pavel Tikhonov, Elena Tutubalina, I. Oseledets et al. · 0 citations
#natural language process... Preprint Sep 2026

What Attention Recalls and Recurrence Controls in Hybrid Language Models

Two cache-level interventions are introduced: Split-prefill keeps only the KV cache or only the recurrent state from a prefilled context, then generates an answer, and state-swap pairs the KV cache from one context with the recurrent state from another in a single forward pass.

Kirill Afendulev, Alexey Dontsov, Elena Tutubalina et al. · 2 citations · ⚡1

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.