Unleashing the Power of CLIP as a General Teacher for Multi-Task Learning
Multi-task learning (MTL) improves efficiency and performance by jointly learning multiple related tasks through shared representations. However, inter-task interference can impair the generalization of these representations, leading to negative knowledge transfer. Knowledge distillation (KD) has emerged as a promising...