Goal-Conditioned Supervised Learning for LLM Fine-Tuning
This paper proposes goal-conditioned supervised learning (GCSL) as an offline fine-tuning framework for LLMs and proposes natural-language goal representations to further connect these patterns to the LLM's pretrained knowledge and generalization capabilities.