Skip to content

SCoCaT: Success Conditioned Constrained Reinforcement Learning for Spacecraft Docking

Sep 2026 · 0 citations · 30 references
Computer Science

TL;DR

This work identifies a structural failure mode of this method class on terminal-navigation tasks: reaching a precise goal configuration while satisfying safety constraints that tighten along the final approach, and empirically demonstrates that adding a dense per-step success signal via an auxiliary value critic improves the task completion rate while maintaining safety-critical constraint compliance.

Abstract

Termination-based constrained reinforcement learning is attractive for safety-critical robotic deployments: it avoids online optimization at inference, scales easily to many constraints via a single scalar per constraint, and is simpler to implement than commonly used Lagrangian methods. Instead of pricing violations through summed cost penalties, this approach makes violations structurally unprofitable by shortening the effective horizon for each violation. We identify a structural failure mode of this method class on terminal-navigation tasks: reaching a precise goal configuration while satisfying safety constraints that tighten along the final approach. When the goal sits inside the region close to where the constraints become active, the survival-weighted objective makes dwelling outside the goal region strictly preferable to entering, producing high constraint compliance with low task completion. We formalize this pathology and show that a minimal augmentation to off-the-shelf RL algorithms like PPO resolves this ``feasibility collapse''. We empirically demonstrate that adding a dense per-step success signal via an auxiliary value critic improves the task completion rate while maintaining safety-critical constraint compliance. Validation across two representative spacecraft platforms: a 6U-CubeSat spanning the mass and degree-of-freedom envelope of operational proximity operations, and a floating platform testbed for zero-shot sim-to-real transfer in our laboratory, supports the generality of these findings.

View source

Similar papers

Preprint Oct 2026

Constrained Differentiable Policy Learning for Safe Quadrotor Navigation

Differentiable simulation enables efficient policy optimization through analytic gradients, yet safety is commonly incorporated as a weighted penalty, requiring manual tuning of the trade-off between task performance and constraint satisfaction. We instead formulate obstacle avoidance as an explicit constraint and trai...

Yan-Rui Tan, Praveen Krishnapur, Ze-Yu Feng et al. · 0 citations
2026

Reliable Task Allocation for Multirobot System Using Safe Deep Reinforcement Learning

This article addresses the critical reliability and safety challenges in multistation multirobot welding task allocation for automated manufacturing, where conventional task assignment approaches often overlook physical collision risks, leading to system failures and production downtime. Unlike existing methods that ei...

Chao-Xu Mu, Jun-Nan Zhang, Ke Wang et al. · 0 citations
Open access Nov 2026

Uncertainty-Calibrated Hamilton-Jacobi Value Learning for Safe Crowd Navigation

Safe navigation in human crowds requires efficiency and reliability. Learning-based policies run fast but can fail under distribution shift, whereas Hamilton–Jacobi (HJ) reachability offers principled safety guarantees but is computationally expensive. We propose a prediction-conditioned reachability framework that bri...

I. Winata, Junghyun Oh · 0 citations

Constrained Sampling MPC for Safe Contact-Rich Control: From Exploration to Precision via Hybrid Refinement

Constrained Annealing-based Sampling MPC (CAS-MPC), which integrates inequality constraints via a primal–dual weight reshaping scheme that preserves sample diversity, and a hybrid refinement strategy that switches to Sequential Linear–Quadratic MPC for millimeter-level precision once near the goal is proposed.

Chenghao Wang, Diego Romeres, Alexander V. Schperberg et al. · 0 citations
#machine learning Preprint Oct 2026

Reachability-Informed Reinforcement Learning for Multi-Impulse Interplanetary Transfers

Reinforcement learning offers the prospect of a reusable sequential decision-making mechanism for spacecraft trajectory design, motivating policy interfaces that connect learned decisions to the underlying maneuver geometry. This paper develops Reachability Analysis-Informed Reinforcement Learning (RARL) for determinis...

Yashdeep Chaudhary, R. Armellin, Harry Holt · 0 citations
Preprint Oct 2026

Learning Safety-Constrained Whole-Body Loco-Manipulation for Lunar Surface Operations

A Constrained Reinforcement Learning framework for quadrupedal mobile manipulators that learns a single whole-body policy for tracking a 6D end-effector pose specified in task space, with operational limits enforced during learning through a constrained learning mechanism.

Álvaro Belmonte-Baeza, M. Cazorla, G. García et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.