Reinforcement Learning from Self-Feedback (RLSF) is presented, a post-training stage that utilises the model's intrinsic confidence as a self-generated reward and affirms reinforcement learning on intrinsic model behaviour as a principled and data-efficient component of the LLM post-training pipeline.
Carel van Niekerk, Renato Vukovic, Benjamin Matthias Ruppik et al.· arXiv.org· 13 citations· ⚡1
A novel end-to-end framework that combines fully lexicalised representations with an LLM backbone for improved semantic accuracy and employs online reinforcement learning with short-term emotional and long-term task-success rewards for joint optimisation of emotional interaction and task success is proposed.
Shutong Feng, Hsien-Chin Lin, Nurul Lubis et al.· Transactions of the Associat...· 2 citations
This work investigates whether an LLM can use an alternative, low level, symbolic competence such as SQL for unsupervised hallucination detection in some high level task and finds that this approach improves on direct prediction and competes with state-of-the-art hallucination detection methods, while not requiring dom...
Renato Vukovic, Hsien-Chin Lin, Carel van Niekerk et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.