Author

R. Chauhan

h-index 0 View on Semantic Scholar

We have 1 of 2 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Jul 2026

Through the Bottleneck: How Multi-head Latent Attention Separates Content from Position in Language Models

This work presents the first comprehensive mechanistic interpretability study of MLA, training a 114M-parameter transformer and analyzing its representations through SVD, attention head taxonomy, linear probing, and a disruption-attribution analysis.

S. Dhruvil, Fenil Sojitra, R. Chauhan · 0 citations