A linguistically motivated tokenizer for Vietnamese and Chinese that converts each syllable into IPA and factorizes it into three phonological components: onset, rime, and tone is introduced.
Nghia Hieu Nguyen, Thai Bao Huynh, Binh-An Dinh-Le et al.· 0 citations
FEGA is introduced, an unsupervised framework that removes the same active SAE feature across contexts and analyzes the resulting cloud of logit changes, showing that a feature can be interpretable and causally relevant without providing a stable direction for steering.
Phu Gia Hoang, Anwoy Chatterjee, Tanmoy Chakraborty et al.· arXiv.org· 0 citations
Murano is an open source framework for designing, running, and reproducing mechanistic interpretability studies of large language models, intended for researchers across disciplines and builds on existing interpretability and machine learning libraries.
Alireza Bayat Makou, Emirhan Böge, Phu Gia Hoang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.