This work introduces SPEAR (Self-Play Enhancement via Advantage-Weighted Refinement), an efficient online learning algorithm for federated LLM fine-tuning that requires only an interaction-level binary satisfaction signal together with non-answer feedback, without requiring a ground-truth answer to be provided, and doe...
Seohyun Lee, Wen-Zhi Fang, Dong-Jun Han et al.· arXiv.org· 1 citation
Fire (Fisher-Informed REcalibration), a dual-branch framework that recalibrates the supervision applied to correct and incorrect on-policy outputs during fine-tuning, is proposed, which provides substantially more stable self-distillation while maintaining strong downstream performance, particularly in settings where s...
Seohyun Lee, Dong-Jun Han, Seyyedali Hosseinalipour et al.· 0 citations
Echo-GRPO is proposed, a framework that lets the model reason in the words it speaks, and idiolectal paraphrasing is a plug-in module that consistently improves both RL and supervised fine-tuning frameworks for reasoning distillation, demonstrating that policy-aligned supervision extends beyond GRPO.
Ji Soo Lee, Jinyoung Park, Seohyun Lee et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.