Skip to content

Author

Suhyeong Shin

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Forget Attention: Importance-Aware Attention Is All You Need

SSM-Informed Softmax Attention is proposed, which builds Mamba-3-style state transitions, rotation included, directly into the scores alongside FoX's gate and outperforms parameter-matched Transformer and FoX in language modeling and length extrapolation.

Suhyeong Shin, Yeongwook Yang · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.