Compression Beyond the Uncompressed: A Two-Stage Training Recipe for Soft Context Compression in RAG
DEX-Comp is proposed, a two-stage training recipe that separates reliable imitation from targeted exploration and applies outcome-based reinforcement learning to teacher-failed questions to directly optimize answer correctness.
Shuyu Guo, Shuo Zhang, Zhao-Chun Ren
· 0 citations