Author

Taiji Suzuki

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

Learning without Overwriting: A Theory of Self-Distillation and Supervised Fine-Tuning in Continual Reasoning

On-policy self-distillation (OPSD) of large language models (LLMs) has demonstrated the ability to improve reasoning capabilities while preserving previously acquired knowledge. Despite substantial empirical success, the dynamics of OPSD in continual reasoning remain incompletely understood. Modeling LLM reasoning as s...

Shinichi Uemura, Taiji Suzuki · 0 citations

#machine learning Sep 2025

Test time training enhances in-context learning of nonlinear functions

The theory reveals that TTT enables the single-layer transformers to adapt to both the feature vector and the link function, which vary across tasks, which creates a sharp contrast with ICL alone, which is theoretically difficult to adapt to shifts in the link function.

Kento Kuwataka, Taiji Suzuki · arXiv.org · 4 citations