3 papers indexed here
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
Adaptive Mutual Distillation for Balanced Multi-Task Post-Training of Large Language Models
Multi-task post-training of large language models (LLMs) aims to improve performance across tasks with unequal amounts of training data. Existing methods focus primarily on balancing task contributions during single-model training. Different task-balancing strategies can produce models with complementary strengths, cre...
ACTD: Anchor-Based Cross-Tokenizer Distillation with Residual Regularization
An Anchor-Based Cross-Tokenizer Distillation with Residual Regularization with Residual Regularization (ACTD) bridges structural heterogeneity through vocabulary and sequence alignment, while mitigating alignment noise via a novel anchor loss with residual regularization.