Open access
Aug 2026
Sparse Autoencoders Reveal Structural and Family-level Features in BiRNA-BERT
SPIRAL is presented, a layer-wise SAE analysis of BiRNA-BERT, a layer-wise SAE analysis of RNA language models where byte-pair tokenization breaks the one-token-one-nucleotide correspondence that nucleotide-level attribution assumes.
M. Hossain, MD. Roqunuzzaman Sojib, Md Toki Tahmid et al.
· bioRxiv · 0 citations