Skip to content

Author

Keitaro Sakamoto

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Locking Pretrained Weights via Deep Low-Rank Residual Distillation

This work proposes DLR-Lock, a method where the purveyor of the model purposely replaces each pretrained MLP in their model with a deep low-rank residual network of comparable parameter count, forcing activation memory that grows linearly with depth during backpropagation, and exploits the inference-training asymmetry...

Keitaro Sakamoto, Pierre Ablin, Federico Danieli et al. · 0 citations
#machine learning Preprint Sep 2026

KV-Lingo: Learning KV-Cache Translators with Distillation

KV-Lingo can be used for seamless model switching, staying close to re-prefill across repeated switches in the authors' multi-turn evaluations, and is found particularly useful for dynamic model routing.

Valérie Castin, Keitaro Sakamoto, A. Filippova et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.