Why Better Cross-Lingual Alignment Fails for Better Cross-Lingual Transfer: Case of Encoders
It is found that embedding-based alignment metrics do not reliably indicate whether alignment will improve or degrade downstream performance, and that the compatibility between alignment and downstream objectives should be considered when designing/evaluating alignment methods.