#artificial intelligence
Apr 2026
Relative Density Ratio Optimization for Stable and Statistically Consistent Model Alignment
The proposed alignment method is statistically consistent and yields significantly tighter convergence guarantees than DDRO, and is based on the relative density ratio between the preferred data distribution and a mixture of the preferred and non-preferred data distributions.
Hiroshi Takahashi, Tomoharu Iwata, Atsutoshi Kumagai et al.
· arXiv.org · 0 citations