Aug 2026
GLA-LoRA: Parameter-efficient LLM fine-tuning with global-local knowledge alignment.
GLA-LoRA establishes a unified learning strategy that synergistically integrates multi-granular contrastive learning with knowledge distillation and establishes that explicit global-local knowledge alignment is essential for achieving high-fidelity, parameter-efficient fine-tuning across diverse language tasks.
Hao Wu, Jianqi Gao, Xiangfeng Luo
· Neural Networks · 0 citations