Skip to content

Learning Input-Constrained Funnel Controllers from State Trajectory Data

Jul 2026 · arXiv.org · Vol abs/2607.23876 · 0 citations · 19 references
Engineering Computer Science

TL;DR

This work synthesizes a prescribed performance controller by combining nominal model compensation with a learned state-dependent feedback gain and establishes two complementary guarantees: a semi-global conservative actuator-authority-based certificate for prescribed performance and input satisfaction, and a local data-driven certificate ensuring these properties near sufficiently dense demonstrated trajectories.

Abstract

Designing feedback controllers that satisfy predefined performance specifications while enforcing hard input constraints is a challenging task. Our work is motivated by the idea that state trajectory data, e.g., obtained from an expert controller, often implicitly encode feasible performance attributes and input limitations. We propose an optimization-based framework that uses state trajectory data to jointly learn: (i) a performance funnel that mimics the transient and steady-state behavior encoded within the observed trajectories, and (ii) a feedback controller that enforces the learned performance specifications under hard input constraints. Unlike imitation learning methods, the proposed approach does not rely on control input data and does not reconstruct an expert policy. Instead, it synthesizes a prescribed performance controller by combining nominal model compensation with a learned state-dependent feedback gain. The resulting synthesis problem is nonconvex, for which we develop a feasibility-driven active-set synthesis procedure. Finally, we establish two complementary guarantees: a semi-global conservative actuator-authority-based certificate for prescribed performance and input satisfaction, and a local data-driven certificate ensuring these properties near sufficiently dense demonstrated trajectories.

View source

Similar papers

#reinforcement learning Open access Sep 2026

Off-Policy Inverse Q-Learning Algorithm with Unobservable States

This paper investigates the output-feedback inverse reinforcement learning (IRL) problem and proposes a data-driven output-feedback off-policy inverse Q-learning algorithm that relies solely on input–output trajectory data from an expert system to address the problem of an unknown performance index in discrete-time lin...

Zheng-Lin Li, Li-Qi Zhang, Xi-Sheng Dai et al. · 0 citations
Preprint Sep 2026

Risk-Aware Motion Planning and Control under Unknown Dynamics with Hybrid Observations

This work addresses blind regions by selecting nominal dynamics and precomputing open-loop control sequences before observation is lost, and guides the robot from an initial state to a target while balancing route efficiency and the risks associated with traversing blind regions.

Zhi-Quan Zhang, M. Ornik · 0 citations
Preprint Oct 2026

Data-Driven Static Output-Feedback Control for Multi-Agent Systems

This work proposes a data-driven framework that synthesizes output-feedback control for linear time-invariant multi-agent systems (MAS). We first develop two algorithms that use offline data samples of state and input trajectories to determine a Nash equilibrium (NE) for MAS. Next, we formulate a semidefinite program t...

Paul Serna-Torre, Adam B. Sedlak, Patricia Hidalgo-Gonzalez · 0 citations
Preprint Sep 2026

Stability-aware Residual Reinforcement Learning Framework for Robotic Manipulator Disturbance Compensation

A residual reinforcement learning DOB framework that pairs an analytical observer with an RL policy is proposed that derived and enforced a state-dependent action bound on the RL policy from an input-to-state stability (ISS) analysis such that the closed loop provably confines the tracking error to a certified envelope...

Jihong Kim, Joonhyuk Kwon, H. Kim et al. · 0 citations
Preprint Sep 2026

Joint Observer-Based Output-Feedback Robust Guidance and Control Funnel Synthesis

A joint guidance and robust observer-based output-feedback synthesis framework is developed for discrete-time nonlinear systems subject to bounded process disturbances and measurement noise. The method co-designs a reference trajectory, time-varying Luenberger observer and observer-based linear output-feedback gains, a...

Cheng Chang, Shiva Shakeri, M. Mesbahi · 0 citations
Conference Open access 2026

Event-triggered output-feedback ADP for single-joint robotic manipulators with unknown dynamics

Robotic systems frequently operate under parametric uncertainties and constrained communication bandwidths, motivating data-driven control architectures that ensure optimal performance without explicit model identification. Conventional adaptive dynamic programming (ADP) methods for output-feedback control typically re...

Sasa Prodanovic, Emanuel Bernardi, X. Luan et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.