Self-Consuming Generative Models with Co-Evolving Human Preferences
Generative models are increasingly trained in self-consuming iterative loops, where users curate preferred samples from model-generated candidates and the curated samples are used to train future generations of the model. Prior work has largely assumed fixed user preferences, but in practice exposure to model outputs g...
Xiu-Kun Wei, Tian Xie, Ding Zhu et al.
· 1 citation