Demystifying Reinforcement Learning Post-Training of Language Models
This work deconstructs the RL post-training algorithm, investigating each step to clarify what is actually happening beneath the surface, and uses the entropy of the policy's output distribution as a lens to compare the distributions learned through pretraining, SFT, and RL post-training, revealing how each stage shapes model certainty.
D. Clay, Saket Gollapudi, Sankar V Harilal et al.
· 0 citations