On-policy self-distillation (OPSD) trains a large language model using supervision from a teacher instantiated from the same model as the student. The teacher is conditioned on privileged information (PI), such as verified solutions. The student, which does not observe PI, learns from the teacher's next-token distribut...
Jiazheng Li, Yawei Li, Jun-Ru Lu et al.· 0 citations
GraphMind, a model that jointly processes micro- and macro-level structures for novelty prediction and rationale generation, is proposed that significantly outperforms baseline LLMs in both novelty score prediction and rationale generation.
Italo Luis da Silva, Hanqi Yan, Lin Gui et al.· Proceedings of the 32nd ACM...· 1 citation
Scientific papers may relate by problem, method, result, or contribution, but document-level retrievers collapse these into a single similarity score without saying why they are related. Citation- and similarity-based retrieval alone also confines search to the neighbourhood of what is already known, whereas generative...
Italo Luis da Silva, Hanqi Yan, Yujing Wang et al.· 0 citations
This work proposes ASRD (Anchor Supervised Revocable Decoding), a training-free framework that operates within the embedding space and outperforms recent remasking baselines, achieving accuracy improvements of up to 6.4\% while accelerating inference throughput by up to 7.2$\times$.
Assessing scientific novelty is inherently complex, requiring evaluation of both a paper's internal structure and its contribution within the broader research landscape. Existing large language model (LLM) approaches often rely on surface-level similarity or citation retrieval, overlooking the integration between a pap...
Italo Luis da Silva, Hanqi Yan, Lin Gui et al.· Proceedings of the 32nd ACM...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.