Supervised fine-tuning (SFT) equips large language models (LLMs) with specialized capabilities, but often comes at the cost of forgetting the general capabilities of their parent models (i.e., the pretrained models before fine-tuning). This trade-off is especially limiting for queries that require both specialized and...
Ke-Nan Tang, An-Dong Hua, Cheng-Xuan Qian et al.· 0 citations
Embodied agents now take on ever longer tasks. For long tasks, knowing only whether a task finally succeeds or fails says little; the steps along the way matter. Progress Reward Models (PRMs) score how far a task has come at every step, and serve as dense rewards, verifiers and monitors. Yet in long tasks the current f...
Jian-Shu Zhang, Ke-Liang Wu, Cheng-Xuan Qian et al.· 0 citations
A user-centric framework for systematically auditing system prompts in AI systems, AISPA is introduced, a user-centric framework for systematically auditing system prompts in AI systems that examines specific parts of a system prompt and evaluates them along eight dimensions that matter to users.
Xiangning Lin, Shenzhe Zhu, Shu Yang et al.· arXiv.org· 0 citations
A unified view of progress reward modeling for robotic learning is provided in three connected steps that connect what a progress model is, how it is built, and how its quality is validated.
Jian-Shu Zhang, Ke-Liang Wu, Haoran Lu et al.· arXiv.org· 5 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.