Preference-based reward shaping can guide reinforcement learning, but adding preference signals to the reward may unintentionally change the task being optimized. We address this problem with IncentRL, a framework that introduces preference guidance while explicitly characterizing its effect on external-task performanc...
The Statistical Godel Machine is introduced, the first statistical safety layer for recursive edits, which replaces proof-based requirements with statistical confidence tests (e-values, Hoeffding bounds), admitting a modification only when superiority is certified at a chosen confidence level, while allocating a global...
Xue-Ning Wu, Shen Yin, Yan-Lan Kang et al.· arXiv.org· 9 citations· ⚡1
This analysis explains why conditional mutual information alone cannot certify escape and measures variation among intervention-conditioned updates rather than departure from the no-intervention law.