Il-Min Kim

NormFit: A Lightweight Solution for Few-Shot Federated Learning with Non-IID Data

NormFit, a lightweight solution that selectively fine-tunes only a very small portion of the model parameters, specifically only the Pre-LayerNorm parameters of the vision encoder within a VLM, sets a new benchmark by simultaneously achieving superior accuracy and substantially reduced communication and computational demands.