Understanding LoRA Rank Trade-offs in Diffusion Model Fine-Tuning
Results show moderate ranks are most efficient: rank 4 achieves the best DDPM FID, rank 8 is close, and higher ranks provide limited gains despite larger adaptation cost, support small-to-moderate ranks as practical defaults under fixed training budgets.
Iman Khazrak, N. Nejad, Mostafa M. Rezaee et al.
· 0 citations