Residual-Gradient Adaptation (ReGRA) is proposed, a two-stage method for making more effective use of a fixed rank budget and achieves stronger performance than alternatives with the same total rank and even matches LoRA adapters with twice the rank.
Fan-Yao Li, Yu-Xi Liu, Xiao-Hao Liu et al.· 0 citations
Hyperbolic geometry has recently emerged as a powerful representation space for multimodal learning, as it naturally captures hierarchical semantic structure across modalities. Despite this progress, how such representations behave under continual learning poses fundamentally different challenges that remain underexplo...
Jia-Hong Liu, Ming Shen, Xiao-Hao Liu et al.· 2 citations
Emotional expression can influence the safety decisions of large language models (LLMs), offering a potential avenue for improving safety alignment. Existing studies have mainly focused on how emotional expressions facilitate attacks under harmful requests, while overlooking their effects on benign requests. We find th...
Shu-Yi Miao, Yao-Jin Ma, Chen-Hang Cui et al.· 0 citations
Across a unified 16-task classification-retrieval stream with three hyperbolic backbones, HMCL improves final performance and backward transfer over sequential fine-tuning and four continual-learning baselines; HMCL-CA gives the highest Overall score on every backbone.
Jia-Hong Liu, Ming Shen, Xiao-Hao Liu et al.· 0 citations
CLLPU (Cross-Lingual and Language-Bound Protocol for LLM Unlearning), a multilingual benchmark that formulates this problem through two settings: common-goal forgetting, where target knowledge should be suppressed across all languages, and language-conditioned forgetting, where suppression should remain confined to a d...
Pengyang Shao, Chuan-Peng Lu, Wei Qin et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.