Safety-aligned gradient enforcement (SAGE) is presented, which uses a differentiable finite-penalty proposal map while retaining the exact CBF quadratic program for execution, preserving constraint-normal sensitivity to internalize repeatedly active safety constraints.
Abstract
Multi-party human-robot collaboration poses a dual challenge: robot decisions should remain interpretable and auditable, while executed actions must satisfy safety constraints during physical interaction. Combining explainable decision-tree policies with control-barrier-function (CBF) filtering provides a promising architecture but creates two learning mismatches in multi-agent reinforcement learning. Safety projection changes the action applied to the environment, while the coupled proposal graph can misalign independently optimized actor updates with a team-level update. We present safety-aligned gradient enforcement (SAGE) to address both mismatches. Its shield-annealed internalization layer (SAIL) uses a differentiable finite-penalty proposal map while retaining the exact CBF quadratic program for execution, preserving constraint-normal sensitivity to internalize repeatedly active safety constraints. Team-averaged Lyapunov policy optimization (TALO) constructs a team-aware update reference and applies a Lyapunov half-space correction to regulate independent actor updates. Physical experiments with two humanoid robots and a human partner demonstrate deployment feasibility. Across nine simulation scenarios, SAGE achieves a 71.0% success rate with 0.5 collision steps per thousand environment steps. Ablations show that direct CBF filtering reduces collision frequency by 98.5% but decreases success from 67.3% to 59.3%. SAIL reduces proposal violation by 48.8% and proposal-execution correction by 85.2%, while TALO reduces the update-consistency gap by 50.8%.
Model-based control can directly execute specified objectives, while learning can amortize such behaviors into reactive policies, making their combination a natural solution to multi-stage manipulation. We introduce Semantically UNified (SUN) Programs, typed executables that compile grounded relations into aligned opti...
Wei-Qi Wang, Zhi Li, Yuliang Lei et al.· 0 citations
Robots operating in human-centered environments must safely navigate among multiple dynamic obstacles to avoid collisions with people and surrounding infrastructure. Control barrier functions (CBFs) provide an effective mechanism for safety filtering, and recent CBF-based reinforcement learning (RL) methods embed such...
Sanghyuk Park, Kwan-Woo Lee, Taekyung Kim et al.· 0 citations
PreferenceFlow, a framework for improving a pretrained flow policy at test time without environment rewards or updates to the base policy, andlations support the roles of gradient regularization and correctly ordered preference labels in the evaluated settings.
Yiqi Tang, Di-Yuan Shi, Run-Ze Li et al.· arXiv.org· 0 citations
Control barrier functions (CBFs) provide a mathematically grounded framework for enforcing local collision-avoidance constraints in autonomous mobile robots, commonly through optimization-based safety filters. However, a minimum-intervention CBF filter lacks task-level maneuver awareness and may fail to select a produc...
Shi-Bo Li, Zhong-Cheng Wang, Jia-He Cao et al.· 0 citations
This work introduces CoRE, which learns Collaboration-Role Experts from pooled multi-task, multi-robot demonstrations, and achieves the highest average performance among evaluated decentralized methods.
Ya-Nan Zhou, Zhao-Yan Qian, Zi-Hao Li et al.· 1 citation
Safety to Competence (S2C), a two-stage RL framework that separates safety synthesis from competitive task learning, is proposed and it is proved that perfect filtering preserves policy non-exploitability when all players commit to safe maneuvers.
Rui-Han Wu, Rui Yang, Donggeon David Oh et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.