Skip to content

Author

Ryo Karakida

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

Measuring the local shape of learning-rate transfer curves

Understanding the learning-rate (LR) dependence of trained model performance is essential for better optimization of neural networks, but the appropriate size of the LR depends on learning dynamics, architecture, and their hidden biases, and thus our understanding of this complex dependence remains limited. The behavio...

Satoki Ishikawa, Rio Yokota, Ryo Karakida · 0 citations
#machine learning Preprint Oct 2026

Gaussian Equivalence for Multi-Head Self-Attention

Using random matrix theory, Gaussian equivalence is established for multi-head self-attention: replacing softmax attention with rescaled scores plus Gaussian noise preserves the limiting spectral law of the centered output.

Tomohiro Hayase, Ryo Karakida · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.