Safe-Stop is proposed, a task-agnostic framework that pairs a learned stop policy with learned stoppability estimators, and yields decisions that are robust without sacrificing reactivity.
Abstract
Humanoid robots responding to emergency stop commands typically execute a fixed maneuver, without reasoning about whether a safe stop is actually feasible from the current state. We cast emergency stopping as a reach-avoid problem and propose Safe-Stop, a task-agnostic framework that pairs a learned stop policy with learned stoppability estimators. The estimators are complementary: a stop-probability estimator supervised by the actual outcomes of the fixed stop policy, and a reach-avoidance estimator supervised by a Hamilton-Jacobi backup over physical state. The first captures emergent stopping behavior of the learned controller; the second provides a complementary recoverability signal. Because the stop policy and estimators do not depend on the behavior policy that preceded the stop command, they transfer across diverse upstream tasks without retraining. At deployment, the two estimates are combined: Safe-Stop commits to the stop only when both estimators indicate that stopping remains feasible, otherwise it hands off to a fall policy, instantiated as a damping fallback. This agreement check yields decisions that are robust without sacrificing reactivity.
Robots engaged in fast physical interactions often need to act before the intent of another agent is fully known. Anticipatory goalkeeping illustrates this challenge. Waiting provides more reliable information about the target but reduces the physical opportunity for interception, whereas acting early preserves reachab...
A robot can predict failure and still be unable to prevent it. By the time a safety mechanism reacts, the nominal plan may already have spent the control authority that recovery requires, and fixed task priorities may block whatever response remains. Our key insight is that both aspects are decided inside the controlle...
Ishaan Mahajan, Charles Chen, F. Dümbgen et al.· 0 citations
Dynamic humanoid motions such as flips risk hardware damage due to suboptimal policies, disturbances or sim-to-real gaps. A motion tracking policy offers no way out once the maneuver leaves its reference, and a backup policy needs to take over to protect the hardware for a minimum-damage landing. Which backup to use ma...
Safety to Competence (S2C), a two-stage RL framework that separates safety synthesis from competitive task learning, is proposed and it is proved that perfect filtering preserves policy non-exploitability when all players commit to safe maneuvers.
Rui-Han Wu, Rui Yang, Donggeon David Oh et al.· 0 citations
Purely machine learning‐based control strategies often suffer from the lack of safety guarantees. In this manuscript, we introduce a locally applied fallback controller to safeguard Deep Reinforcement Learning in dynamic environments. The fallback controller takes over whenever a safety criterion would otherwise be v...
Simon Gottschalk· Optimal control applications...· 0 citations
A generated video of a task the robot is about to perform is useful guidance only if it depicts the phase the robot is actually in. We show that temporal misalignment can turn a task-consistent generated future into actively harmful guidance. On CALVIN, a five-frame early shift nearly erases the benefit of generated fu...
Mohammad Khoshnazar, Mohammad Dehghani Tezerjani, Zhi-Yuan Gao et al.· 0 citations