One Form to Transfer Them All: Pretraining Multilingual Language Models Beyond Native Orthography
These results indicate that for multilingual models spanning typologically diverse scripts, to obtain maximum benefits, romanization should be treated as a core design choice applied at pretraining rather than a post hoc fix.
Mu-Ge Zhang, Aaron Jencks, Krishna Badikela et al.
· 0 citations