Rank Measures of Fine-Tuning Updates Need a Noise Baseline
The baselines show that a random update of the same size leaves that rank almost unchanged while wrecking the model, and that an edit built on the effective rank of the update has no measurable effect in the authors' tests.
Muhammad Usman Altaf
· 1 citation