This work shows that intermediate states surface salient entities early in the denoising trajectory, making them a useful lookahead signal for retrieval-augmented generation (RAG), and demonstrates that grounding generation in retrieved evidence sharply reduces inter-token dependence, making RAG particularly well suite...
Paul J. Jünger, Justin Lovelace, Lin-Xi Zhao et al.· arXiv.org· 2 citations· ⚡1
Experiments show that MoRE consistently achieves lower perplexity and stronger downstream performance than standard MoEs and state-of-the-art weight-sharing architectures at matched compute and parameter budgets, with only minimal modifications to existing MoE implementations.
Eric S. Qiu, U. U. Acikalin, Justin Lovelace et al.· 1 citation
Optizing Your Sampling (OYS), which instead treats timestep selection as a black-box optimization problem, optimizing the target metric directly with Bayesian optimization, improves both simple and sophisticated samplers such as Euler and DPM-Solver++.
Travis Zhang, Christian K. Belardi, Justin Lovelace et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.