Olivier Ferret

Procrustes Analysis for Improving Language Model Merging

This article proposes a new method for merging fine-tuned neural language models for the same task, derived from the same encoder-based model, based on Procrustes analysis, and shows that this method can improve upon existing merging methods in most tested configurations.