This work investigates how fine-tuning alters internal representations in LLMs, including attention patterns and layer-wise activations, and examines whether these changes are linked to task-relevant components identified by EAP that drive task performance.
Ling-Fang Li, Procheta Sen, Shubham Das et al.· 0 citations
It is found that providing candidate senses, similar to what is done in traditional WSD, improves WiC performance in all settings and helps models make more consistent and targeted judgements.
Yi Zhou, Kiamehr Rezaee, Danushka Bollegala et al.· 0 citations
Experimental results show that LLMs exhibit social bias even in coherent, response-conditioned multi-turn interactions, revealing late-emerging bias, non-monotonic bias patterns, and bias re-emergence, which motivate evaluations that extend beyond fixed-turn, pre-scripted protocols.
Rem Hida, Masahiro Kaneko, Daisuke Oba et al.· 0 citations
This work proposes CAROT (Cross-Lingual Alignment of Representations in a Language-Agnostic Space via Optimal Transport), which consists of identifying language-specific representations in LLMs'internal states and aligning language-agnostic representations across languages at the token level by optimal transport, while...
Taisei Yamamoto, Ryoma Kumon, Danushka Bollegala et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.