Hong-Yu Jiang

Reinforcement Learning Methods and Optimization Strategies in Preference Alignment Techniques for Large Language Models

This paper investigates the development path of large language model preference alignment techniques, focusing on the training mechanism of Reinforcement Learning from Human Feedback and its three-stage process, including supervised fine-tuning, reward model training, and PPO-based policy optimization.