Rethinking Layer-Wise Information Allocation for Vision Foundation Model Adaptation
Inspired by the Information Bottleneck principle, Prompted Information Bottlenecks (PIB) is introduced, a framework that regularizes layer-wise compression-sufficiency trade-offs and promotes a more coherent cross-layer information path.